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ABSTRACT 

In  computer  vision  many  techniques  have  been  developed  for  object  recognition. 
The  afTme  invariant  matching  algorithm  proposed  by  Hummel  and  Wolfson  (1988)  is  a 
new  and  interesting  method.  Under  afTme  invariant  transformation,  objects  with  trans- 
lation, rotation,  scale  changes,  and,  or  even  partial  occlusion  will  have  the  same  or  simi- 
lar coefficients.    However,  some  serious  problems  exist  in  the  original  algorithm. 

This  thesis  begins  with  the  discussion  of  the  affme  transformation.  The  shortcom- 
ings that  can  occur  in  this  method  such  as  the  basis  instability,  the  collision  of  hash  ta- 
ble, and  the  noise  sensitivity  will  be  discussed.  Among  them  the  noise  sensitivity  is  a 
serious  problem.  This  can  always  cause  the  recognition  procedure  to  fail.  In  this  thesis 
an  improved  affme  invariant  matching  algorithm  was  developed  to  overcome  the  noise 
problem  and  other  disadvantages  of  the  original  algorithm. 

The  area  test  criteria  were  adopted  to  avoid  the  numerical  instability  problem.  The 
modified  hashing  structure  using  a  special  hash  function  was  implemented  to  achieve 
faster  accessing  and  voting.  In  the  recognition  procedure,  the  partial  voting  technique 
with  the  consideration  of  false  peaks  from  the  voting  array  highly  enhanced  the  noise 
tolerance  of  the  algorithm.  Finally,  the  results  obtained  from  the  improved  algorithm 
clearly  showed  better  performance  than  those  of  the  original  algorithm. 


m 


TABLE  OF  CONTENTS 

I.  INTRODUCTION   1 

II.  DISCUSSION  ON  AFFINE  INVARIANT  MATCHING   4 

A.  AFFINE  TRANSFORMATION  OF  PLANAR  POINTS    4 

1.  General  Statement     4 

2.  Transform  Representation 4 

B.  ORIGINAL  MATCHING  ALGORITHM     5 

1.  Preprocessing  (Ofl-line  Step)    5 

2.  Recognition  (On-line  Step)     8 

C.  SHORTCOMINGS  OF  AFFINE  INVARIANT  MATCHING    8 

1.  Basis  Instability     8 

2.  Collision  of  Hash  Table     11 

3.  Noise  Perturbation    11 

D.  SOLUTIONS  TO  THE  PROBLEMS     16 

1.  Screening  to  Reduce  Numerical  Instability     16 

2.  Hashing  Function    17 

3.  Noise  Problem     17 

a.  Quantization  in  the  AfTme  Plane     17 

b.  Improved  Hash  Structure   22 

c.  Partial  Voting     23 

III.  ALGORITHM  IMPLEMENTATION     26 

A.     PREPROCESSING  (DATA-BASE  SETUP)    26 


IV 


1.  Rule  Out  the  L'ndesired  Triplets     26 

a.  COMBINATION     28 

b.  SELECTION     28 

c.  PERMUTATION     28 

2.  Calculation  of  AfTine  CoefTicients     28 

3.  Quantization  of  the  AfTine  Plane    29 

a.  SCATTER     29 

b.  QUANTIZATION     29 

4.  Hash  Table  Generation   30 

a.  KEY-CONVERSION     31 

b.  HASHING    31 

c.  COLLISION    31 

B.     RECOGNITION  (IDENTIFICATION  OF  TEST  OBJECTS)    32 

1.  Calculation  of  Input  Data   32 

2.  Afilne  Matching    32 

a.  PARTIAL  VOTING    32 

b.  TOP-SIX-MAX    36 

c.  ALL-MAX-SELECTION     37 

d.  CHECK     37 

3.  RECONSTRUCTION     37 

4.  VERIFICATION    37 

IV.     EXPERIMENTAL  RESULTS  AND  PERFORMANCE     38 

A.     NOISE-FREE  TESTS     38 

1.  Similarity  Transformation  Test     38 

2.  Occlusion  Test     38 


B.  NOISE  PERTURBATION  TESTS     42 

C.  PERFORMANCE     48 

D.  EXPERIENCE  GAINED   55 

1.  Numerical  Instability     55 

2.  Hashing  Function    55 

3.  Quantization  of  AfTine  Plane    55 

4.  Modified  Hash  Structure   56 

5.  Partial  Voting  Technique     56 

6.  False  Peaks  of  Voting  Array    56 

7.  Noise  Perturbation    56 

8.  Speed  and  Complexity     57 

V.     CONCLUSIONS  AND  FUTURE  RESEARCH     58 

APPENDIX  A.     PASCAL  SOURCE  CODE    60 

LIST  OF  REFERENCES   88 

INITIAL  DISTRIBUTION  LIST     89 


VI 


LIST  OF  FIGURES 

Figure     1.  Afilne  invariant  characteristic     7 

Figure     2.  Flow  cliart  of  the  afilne  invariant  matching  algorithm 9 

Figure     3.  Geometrical  interpretation  of  afilne  transformation 12 

Figure     4.  Histograms  of  the  afilne  coelTicients    13 

Figure     5.  Voting  results  of  the  accumulation  array  in  the  hash  table     15 

Figure     6.  Hashing  functions  of  atan,  asinh,  and  tanh    18 

Figure     7.  Calculation  of  the  bounds  of  afilne  coefilcient     20 

Figure     8.  Generation  of  inkey  and  hashkey    24 

Figure     9.  Partial  voting  technique    25 

Figure  10.  Flowchart  of  the  preprocessing  step    27 

Figure  1 1.  Structure  of  the  hash  table    33 

Figure  12.  Flowchart  of  the  recognition  step    34 

Figure  13.  Structure  of  the  tally  data  file    35 

Figure  14.  Data-base  models  of  SETl(above)  and  SET2(below)    39 

Figure  15.  Similarity  transform  test  of  SETl    40 

Figure  16.  Similarity  transform  test  of  SET2    41 

Figure  17.  Occluded  objects  test  of  SETl     43 

Figure  IS.  Occluded  objects  test  of  SET2     44 

Figure  19.  Error  region  of  the  disturbed  interesting  point      45 

Figure  20.  Plot  of  the  test  objects  of  SETl  with  four  interesting  points  disturbed    .  46 

Figure  21.  Recognition  of  SETl  with  four  interesting  points  disturbed    47 

Figure  22.  Plot  of  the  test  objects  of  SET2  with  six  interesting  points  disturbed    .  .  49 

Figure  23.  Recognition  of  SET2  with  six  interesting  points  disturbed    50 


\Tll 


Figure  24.  Plot  of  the  test  objects  of  SETl  with  seven  interesting  points  disturbed     51 

Figure  25.    Recognition  of  SETl  with  seven  interesting  points  disturbed    52 

Figure  26.  Plot  of  the  test  objects  of  SET2  with  ten  interesting  points  disturbed    .  .  53 

Figure  27.    Recognition  of  SET2  with  ten  interesting  points  disturbed 54 


vm 


ACKNOWLEDGMENTS 

I  wish  to  express  my  thanks  to  my  Thesis  Advisor,  Dr.  Chin-Uwa  Lee,  for  his 
understanding,  infinite  patience,  and  guidance.  I  would  also  like  to  thank  Dr.  Muiali 
Tummala  who  provided  a  lot  of  help  and  enthusiasm  when  it  was  greatly  needed.  Last, 
but  by  no  means  least,  I  would  like  to  extend  deep  appreciation  to  my  family  and  friends 
who  gave  their  total  support  throughout  the  entire  project. 


IX 


I.     INTRODUCTION 

Recognition  of  objects  in  natural  scenes  is  a  major  subject  of  study  in  computer  vi- 
sion. It  is  important  in  many  applications  including  robotics,  automated  inspection,  and 
aerial  photo-interpretation.  A  number  of  practical  recognition  systems  are  model-based 
systems  where  the  task  is  to  match  known  models  against  the  test  objects  in  the  scene. 

Generally,  according  to  the  matching  scheme  the  techniques  for  2-D  object  recog- 
nition can  be  classified  into  three  categories.  They  are  template  matching,  feature 
matching,  and  transform  matching.  Template  matching  is  the  oldest  technique  known. 
It  is  basically  a  technique  of  2-D  cross-correlation  between  the  model  object  and  the  test 
object.  In  feature  matching  a  structural  model  of  the  object  in  terms  of  features  or  ob- 
ject primitives  is  constructed.  Recognition  is  based  on  the  structure.  These  features  can 
be  served  as  a  compact  description  of  the  object  and  can  be  easily  extracted  from  it. 
The  above  two  matching  techniques  are  performed  in  the  original  2-D  spatial  domain. 
The  last  approach  is  to  transform  the  original  data  into  a  different  domain  with  the 
matching  done  in  this  new  domain.  [Ref.  1:  pp.  14-20] 

The  representation  method  of  an  object  determines  the  complexity  of  the  matching 
algorithm  and  also  places  a  limit  on  the  capability  of  the  matching  algorithm.  For  ex- 
ample, a  representation  based  on  the  Fourier  Descriptors  can  not  handle  the  partially 
occluded  objects  because  of  its  global  Fourier  feature.  Therefore,  an  ideal  object  repre- 
sentation shall  have  the  following  desirable  characteristics  [Ref  2]  : 

•  It  should  be  local.  This  means  that  the  coding  of  an  object  is  not  dependent  on  the 
entire  boundary',  nor  is  it  dependent  on  an  external  reference  point  such  as  a 
centroid  or  a  starting  point. 


•  It  should  be  independent  of  the  orientation,  scale,  and  even  partial  occlusion  of  the 
object. 

•  It  should  be  bounded.  This  means  that  a  small  change  to  part  of  the  boundary 
should  produce  only  a  small  local  change  in  the  representation. 

•  It  should  allow  for  efllcient  and  robust  matching  in  the  presence  of  noise. 

•  It  should  uniquely  specify  a  single  object. 

•  It  should  contain  information  about  the  object  at  var\'ing  levels  of  details  so  that 
the  matching  process  can  be  performed  at  different  levels  of  coarseness. 

•  It  should  be  computationally  efficient. 

These  characteristics  of  object  representation  are  ideal,  and  it  is  by  no  means  obvious 
from  the  outset  that  a  representation  with  such  characteristics  can  be  found. 

Many  techniques  were  developed  for  object  representation  and  matching  in  the  above 
three  categories,  but  none  of  them  are  simultaneously  orientation,  scale,  and  occlusion 
invariant.  The  affme  invariant  matching  proposed  by  Hummel  and  Wolfson  (1988)  is  a 
new  and  efficient  transform  matching  technique  which  can  handle  objects  with  changes 
in  scale,  orientation,  and  partial  occlusion.  However,  this  technique  has  some  short- 
comings. 

The  purpose  of  this  thesis  is  to  discuss  these  shortcomings  and  derive  the  solutions 
to  overcome  the  corresponding  problems.  There  are  five  chapters  included  in  this  thesis. 
Chapter  I  is  a  brief  description  of  2-D  object  recognition  and  the  ideal  representation 
characteristics.  Chapter  II  presents  the  principle  of  affine  invariant  transformation  and 
its  original  implementation  on  point  matching.    In  Chapter  III  the  emphasis  is  on  the 


discussion  of  the  shortcomings  of  the  original  matching  algorithm  such  as  the  basis  in- 
stability, the  collision  of  hash  table,  and  the  noise  problem.  Then,  solutions  were  derived 
to  overcome  these  problems.  Among  these  shortcomings,  the  main  weakness  of  the  or- 
iginal matching  algorithm  is  its  sensitivity  to  noise  perturbation.  This  will  always  cause 
the  recognition  procedure  to  fail.  One  side  effect  caused  by  the  solution  to  reduce  noise 
perturbation  is  that  the  matching  algorithm  suffers  from  false  peaks  in  the  accumulator 
array  due  to  the  partial  voting  technique.  All  the  problems  and  solutions  will  be  dis- 
cussed in  detail  in  this  chapter.  In  Chapter  IV,  these  solutions  w^ere  implemented  in  the 
improved  afiine  matching  algorithm  in  order  to  enhance  some  of  the  ideal  characteristics 
of  the  object  representation  and  matching  algorithm.  Hence,  the  new  algorithm  can 
work  better  in  a  real  situation.  In  other  words,  it  can  handle  noisy  test  objects  and  still 
preserve  scale,  orientation,  and  occlusion  invariance.  Chapter  V  shows  the  results  ob- 
tained from  the  computer  experiments.  By  comparing  the  results  reported  here  with  the 
results  of  the  original  algorithm,  the  new  algorithm  clearly  shows  better  performance 
man  the  original  method.  Finally,  Chapter  \T  presents  the  conclusions  and  the  rec- 
ommendations for  future  studv. 


II.     DISCUSSION  ON  AFFINE  INVARIANT  MATCHING 

A.     AFFINE  TRANSFORMATION  OF  PLANAR  POINTS 

1.  General  Statement 

From  a  theoretical  as  well  as  a  practical  point  of  view,  feature  transformation 
is  an  important  topic  in  object  recognition.  The  afTme  transformation  is  a  new  method 
to  characterize  objects  with  invariance  in  respect  to  translation,  rotation,  scale  change, 
and  partial  occlusion.  But  the  most  important  characteristic  of  all  is  the  simplicity  of 
this  method. 

The  study  is  concentrated  on  the  recognition  of  2-D  flat  rigid  objects.  Under 
this  restriction,  two  different  images  of  the  same  flat  object  are  in  afTme  correspondence, 
i.e.,  there  is  a  non  singular  2x2  matrix  A  and  a  2-D  (translation)  vector  b.  such  that 
each  point  x  in  the  first  image  can  be  translated  to  the  corresponding  point  Ax  +  b  in 
the  second  image.  Our  problem  is  to  fmd  the  correspondence  of  the  objects  in  a  scene 
and  a  stored  model  in  the  data  base.   [Ref  3:  pp.  3-4] 

In  order  to  identify  the  occluded  or  overlapped  objects,  a  local  feature  must  be 
used.  Local  features  depend  only  on  the  shape  or  structure  of  the  object  restricted  to  a 
small  area.    In  the  study  here  the  local  point  feature  is  used. 

2.  Transform  Representation 

It  is  well  known  that  any  three  non-collinear  points  (called  a  triplet  or  a  basis 
triplet)  can  uniquely  specify  a  plane.  Consequently,  aflfme  transformation  of  a  plane  is 
associated  with  the  transformation  of  three  non-collinear  points.  Moreover,  the  afTme 
transformation  is  unique  because  it  maps  any  non-collinear  triplet  in  one  plane  to  an- 
other non-collinear  triplet  in  the  other  plane. 


Suppose  a  set  of  points  (called  interesting  points)  of  an  object  is  extracted  from 
an  image.  Any  three  non-collinear  points  of  the  set  form  a  triplet.  The  affine  coefficients 
{c,i])  of  the  rest  of  the  points  of  the  object  can  be  calculated  based  on  this  particular 
triplet.  The  most  important  characteristic  of  this  transform  is  that  for  each  non-collinear 
triplet  the  affme  coefficients  of  all  other  points  of  the  object  are  affme  invariant.  In 
other  words,  the  same  point  of  the  object  transformed  on  different  basis  will  have  the 
same  affme  coefficients. 

Let  a,  b,  c  denote  the  vectors  of  a  selected  triplet  of  the  plane,  and  T  denotes  the 
transformation  to  a  different  plane.  As  shown  in  Figure  1,  one  can  express  the  affme 
coefficients  {c,  rj)  of  an  arbitrary  point  p  by  the  following  equation  : 


J  =  (a-c    b-c)-'(p-c)  (2.1) 


/«A        /^A        AA  M 

where  a=  •b=  <c=  .  and  p  = 


^«J,/  \by/  \Cyj 


Hence,  given  the  affme  coefficients  and  the  triplet,  the  corresponding  point  in 
an  image  can  be  computed  by 

p  =  (:(a  -  c)  +  ?/(b  -  c)  +  c.  (2.2) 

If  both  the  point  p  and  its  triplet  are  transformed  by  T  to  a  new  image  plane, 
its  new  affine  coefficients  are 


=  (T(a  -  c)    T(b  -  c))-^T(p  -  c) 
=  (T(a-c    b-c))"'T(p-c) 
=  (a-c    b-c)  T  'T(p-c) 
=  (a  —  c    b  — c)~'(p  — c). 


From  equations  (2.1)  and  (2.3),  it  is  clearly  proven  that  the  alLne  coeincicnts 
are  transform  invariant  [Ref  4:  pp.  3-4].  Figure  1  shows  the  invariant  property  graph- 
ically. 

B.     ORIGINAL  MATCHING  ALGORITHM 

As  was  mentioned  in  the  previous  section,  given  a  triplet,  each  point  of  the  plane 
can  be  represented  as  a  coefficient  pair  (^, ;/)  on  this  basis.  Since  there  is  no  preference 
for  any  specific  triplet,  the  set  of  model  interesting  points  from  the  model  can  yield  a 
large  number  of  non-coUinear  triplets.  Given  m  interesting  points  of  the  model  at  least 
C^Pl  —  N  cases  should  be  considered,  where  N  is  the  number  of  undesired  colUncar 
triplets.  For  object  recognition  considered  here,  interesting  points  of  a  test  object  is 
going  to  be  used  to  match  those  of  the  stored  models.  If  there  are  n  points  in  the  test 
object,  the  worst  case  complexity  for  recognition  using  this  method  is  {ni  x  ny  x  /  ,  wjicrc 
t  is  the  complexity  of  verifying  one  point  of  the  model  against  that  of  the  test  object. 
Again  if  n  and  t  are  in  the  same  order  of  magnitude  as  m,  the  worst  case  complexity 
could  be  of  order  ni\  [Ref  3:  pp.  6)  Such  a  complexity  is  quite  unfavorable.  Hence,  it 
is  necessary  to  divide  the  algorithm  into  two  dilferent  steps.  1  he  first  one  is  an  ofT-liric 
step  called  preprocessing,  and  the  second  one  is  an  on-line  step  called  recognition.  The 
objective  here  is  to  identify  the  test  object  in  a  scene  as  one  of  the  possible  models 
stored.    The  two  steps  are  explained  briefiy  as  follows. 

1.     Preprocessing  (Off-line  Step) 

a)  Represent  the  model  objects  by  a  set  of  interesting  points. 

b)  For  each  non-collinear  triplet,  calculate  the  coefiicients  {t,,  f]}  of  all  the  other  model 
interesting  points  on  this  basis  triplet. 

c)  Use  these  coefiicients  by  hashing  them  into  an  entry  of  a  table  (called  hash  tabic). 
The  entry  stores  all  the  corresponding  pairs  (modelno,  tripletno)  lor  those  afiine  co- 
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Figure   1.      Affine  invariant  characteristic 


efTicients  ((!, )/).  Within  the  hashing  structure  all  entries  with  the  same  coefficients  are 
linked  together  by  pointers. 

d)  This  is  done  for  as  many  models  as  necessary,  i.e.,  for  each  difTerent  model  repeat 
procedures  a)  to  c). 

2.     Recognition  (On-line  Step) 

a)  Input  a  set  of  interesting  points  of  the  test  object  in  an  image. 

b)  Choose  a  non-collinear  triplet  as  a  basis,  compute  the  coefficients  {^,  rj)  of  the  other 
points  based  on  this  triplet. 

c)  For  each  coefficient  pair  (<f,//),  the  hash  table  is  accessed  and  a  vote  for  the  ap- 
propriate entries  is  tallied. 

d)  If  a  certain  entry  in  the  hash  table  obtains  the  largest  number  of  votes,  the  data 
related  to  this  entry  can  be  reconstructed  and  shown  on  the  display. 

e)  Check  another  model  as  necessar}',  i.e.,  repeat  procedures  a)  to  d). 
This  two-step  algorithm  is  illustrated  in  Figure  2. 

C.     SHORTCOMINGS  OF  AFFINE  INVARIANT  MATCHING 

Besides  the  disadvantage  of  complexity,  there  are  other  shortcomings  that  limit  the 
accuracy  and  efficiency  of  the  scheme.  These  shortcomings  are  discussed  in  the  follow- 
ing.  The  solutions  to  these  problems  will  be  the  subject  of  the  next  section. 

1.     Basis  Instability 

In  order  to  understand  the  basis  instability  problem  it  is  advantageous  to  inter- 
pret the  affine  transform  from  the  geometrical  point  of  view.  It  is  possible  to  rewrite 
equation  (2.1)  in  terms  of  the  components  of  the  coordinates  of  vectors  a,  b,  c,  and  p  as 
follows 
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Flow  chart  of  the  affirie  invariant  matching  algorithm 


'iPx      -      Cx){t>y      -       Cy)       -      {b^     -      C^){Py      -      CyY 

i^x  -  Cx){by  -  Cy)  -  {b^  -  c^){ay  -  Cy) 


(2.4) 


More  explicity  the  afTine  coefilcients  are  given  by 


^  = 


JPx  -  Cx)(^y  -  Cy)  -  {b^  -  C^){py  -  Cy) 

i<^x  -  Cx)i^y  -  Cy)  -  [bx  -  Cx){ay  -  Cy)  ' 


(2.5) 


and 


n  = 


i^X  -  ^X^iPy  -  Cy)  -  [Px  -  CxMay  -  Cy) 

i^X     -      Cx)iby     -      Cy)     -     {b^     -      C^){ay     -     Cy)  ^ 


(2.6) 


If  equations  (2.5)  and  (2.6)  are  interpreted  from  the  geometrical  point  of  view, 
I  lie  afTme  coefficients  <f  and  ?/  are  both  ratios  of  areas.  The  area  of  the  basis  triplet  tri- 
angle is  given  by 


"^abc  — 


a^    ay    1 

J_ 

bx    by    1 

Cx         Cy           1 

(2.7) 


The  determinant  can  be  simplified  to 


"^abc  — 


^X-CX  ay-Cy 


bx-Cx  by-Cy 


(2.8) 


or 
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^abc  — 


li^x  -  ^x)iby  -  Cy)  -  [b^  -  C^){ay  -  Cy)'} 


(2.9) 


which  is  identical  to  the  magnitude  of  the  denominator  of  equations  (2.5)  and  (2.6),  ex- 
cept for  the  1/2  factor. 

In  other  words,  the  denominator  of  equation  (2.5)  or  equation  (2.6)  is  propor- 
tional to  the  area  of  the  triangle  for  which  the  vertices  are  the  three  non-collinear  basis 
points  a,  b  and  c.  Similary,  the  numerator  of  t  is  proportional  to  area  A^^^  which  is  the 
area  of  the  triangle  that  consists  of  points  b,  c,  and  p.  The  numerator  of  rj  is  propor- 
tional to  A^,p  which  is  the  area  of  the  triangle  that  consists  of  points  a,  c,  and  p. 
Figure  3  shows  the  geometrical  interpretation  of  the  afTme  transformation. 

If  the  area  o^  A,^,  is  too  small  compared  to  the  area  of  yi^,^,  or  A,^„,  the  magnitude 
of  the  aflme  coefficient  will  be  a  very  large  number.  This  effect  will  cause  the  numerical 
instability  in  the  afTme  plane.  [Ref  4:  pp.  6-7] 

2.  Collision  of  Hash  Table 

Even  if  the  unstable  triplet  points  are  ruled  out,  the  values  of  t  and  r;  tend  to 
concentrate  highly  around  zero,  i.e.,  these  values  are  closing  toward  the  origin  of  the 
affme  plane,  as  shown  in  Figure  4.  These  small  values  of  t  and  ?/  will  generate  many 
long  linked  hsts  in  the  hash  table,  which  causes  serious  colhsions  of  entries  in  the  table. 
Under  this  circumstance,  the  hash  table  accessing  time  increases,  and  the  situation  be- 
comes impractical  due  to  the  numerous  collisions.  Thus,  a  special  function  which  can 
distribute  these  small  values  to  a  large  region  is  needed. 

3.  Noise  Perturbation 

When  the  test  object  appears  in  a  real  scene,  usually  the  extraction  of  local 
feature  (interesting  point)  is  inaccurate  to  a  certain  extent  in  the  presence  of  random 
fluctuations  or  "noise".  In  this  scheme  the  local  feature  used  is  a  set  of  fixed-value  co- 
ordinates of  the  interesting  points.    If  these  points  are  perturbated  in  the  presence  of 
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Figure  3.        Geometrical  interpretation  of  affine  transformation 

noise,  the  corresponding  affine  coefficients  t  and  y]  will  deviate  from  the  accurate  values 
in  the  afTine  plane. 

In  order  to  show  how  the  affine  coefficients  are  affected  by  the  noise,  it  is  ben- 
eficial to  take  a  look  at  a  simple  example  as  shown  in  the  following.  If  the  coordinates 
of  a  test  triplet  <a,  b,  c>  and  an  arbitrar}'  point  p  are  given  by 
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Figure  4.  Histograms  of  the  affine  coefficients:  (a)  original;  (b)  ruling  out  un- 
stable triplets;  and  (c)  same  as  (b)  with  x  axis  scaled  to  smaller  range  of 
values.  [From  Ref.  3:  pp.  8] 
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a  = 


"20' 

"30" 

"40" 

"40" 

.30_ 

,     b  = 

_40_ 

,     c  = 

-30_ 

'     P  = 

-10. 

Using  equations  (2.5)  and  (2.6),  we  have 

Assume  that  the  point  vectors  b  and  p  are  perturbated  by  the  presence  of  noise  and  that 
their  coordinates  change  to 


b  = 


31" 

"40.5" 

_39.5_ 

-     P  = 

11_ 

Again,  by  using  equations  (2.5)  and  (2.6) 


^'  =  0.875,     ?/'  =  -2, 


so  that  the  deviations 


Ac  =  uf  -  <f '  =  0.875,     An  =  tj-r;'  =  0. 

Since  the  affine  coefficients  of  the  model  interesting  points  are  integer  values, 
the  above  small  deviation  will  cause  an  erroneous  or  a  failed  match  in  the  hash  table. 

Figure  5  shows  the  voting  results  of  the  accumulation  array  in  the  hash  table. 
From  this  plot  it  can  be  seen  that  the  votes  of  most  triplets  decrease  due  to  the  noise 
perturbation.  This  means  that  potential  erroneous  matching  can  occur  in  the  hash  table. 

Obviously,  the  affme  transformation  of  a  point  is  very  sensitive  to  noise  per- 
turbation. This  will  always  cause  the  recognition  procedure  to  fail.  For  real  images  the 
background  noise  is  inevitable.  Hence,  the  noise  sensitivity  of  affme  transform  matching 
is  the  main  problem  to  be  solved  in  this  study. 


14 


ra 
l-l 

03 

C 

B 

o 
o 

CO 

a 

Xi 


E 


S910A 


\'oting  results  of  (lie  accumulation  array  in  the  hash  tahle 


15 


D.  SOLUTIONS  TO  THE  PROBLEMS 

This  section  discusses  the  solutions  to  the  shortcomings  of  the  affine  matching  al- 
gorithm. 

1.     Screening  to  Reduce  Numerical  Instability 

The  selection  of  triplets  is  an  important  step  in  either  the  preprocessing  or  the 
recognition  procedures.  If  a  triplet  yielding  a  relatively  small  area  is  used  as  a  basis,  it 
will  cause  large  amplification  of  noise  in  the  affme  plane,  i.e.,  the  error  of  ^  and  rj  will 
become  very  large.  Therefore,  the  solution  to  the  instability  problem  is  to  rule  out  this 
kind  of  undesirable  triplets. 

The  concept  of  "relatively  small  area"  is  an  ambiguous  idea.  It  can  var>'  from 
object  to  object.  It  is  necessar\'  to  explain  this  in  detail.  In  order  to  get  a  refiexible 
criterion,  the  triplet's  area  is  compared  with  the  total  area  of  the  object.  The  following 
restrictions  are  required  for  both  the  preprocessing  and  the  recognition  [Ref  4:  pp.  8]. 

•  In  the  preprocessing  step,  only  the  non-collinear  triplet  with  an  area  of  at  least  1/20 
of  the  total  area  of  the  object  will  be  used. 

•  In  the  recognition  step,  the  non-collinear  triplet  used  should  have  at  least  1,10  of 
the  total  area  of  the  object.  Here,  adoption  of  the  factor  1,T0  instead  of  1/20  is  due 
to  the  consideration  of  noise  perturbation  in  the  recognition  step.  Because  the  in- 
put image  is  always  affected  by  the  background  noise,  a  less  stringent  tolerance  is 

adopted. 

By  ruling  out  these  undesirable  triplets,  not  only  can  the  numerical  instability 
problem  of  this  scheme  be  solved,  but  also  the  bounds  of  coordinates  in  the  affme  plane 
can  be  determined.   This  results  in  a  smaller  and  efficient  hash  table. 
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2,  Hashing  Function 

From  the  observation  of  the  afTine  coefTicients  it  can  be  seen  that  the  higher 
concentration  occurs  at  small  values,  i.e.,  values  of  (^  and  ?/  close  to  the  origin  of  the  2-D 
affine  plane.  The  phenomenon  of  the  concentration  of  small  values  of  affme  coefficients 
induces  many  long  linked  Usts  in  the  hashing  table.  Consequetly,  the  accessing  time  of 
the  hash  table  in  this  algorithm  deteriorates.  Thus,  it  is  intuitively  beneficial  to  use  a 
special  hash  function  to  scatter  those  small  values  as  far  apart  as  possible  in  the  affme 
plane. 

Besides  the  linear  hash  functions  with  bad  performance,  there  are  some  non- 
linear hash  functions  with  a  good  performance  available,  such  as  atan,  asinh  and  tanh. 
Figure  6  shows  these  functions.  From  the  experimental  results,  atan  seems  to  be  the 
best  one  as  it  can  scatter  the  small  affme  coefficients  over  a  wide  range  of  the  affine 
plane  [Ref  4:  pp.  9-10].  Hence,  the  size  of  the  linked  list  can  be  reduced  through  ap- 
propriate quantization  in  the  affme  plane.  The  hashing  concept  and  the  quantization 
problem  will  be  discussed  in  the  next  section. 

3.  Noise  Problem 

The  afilne  invariant  matching  algorithm  is  very  rigid  in  calculating  the  coeffi- 
cients if  and  ;/.  If  the  coefficient  pairs  are  based  on  noisy  interesting  points,  the  recog- 
nition will  fail  due  to  the  error  matching  in  the  hash  table.  Consequently,  the  noise 
sensitivity  of  this  matching  system  is  a  serious  problem.  In  order  to  solve  the  disad- 
vantage of  noise  sensitivity,  some  techniques  to  improve  this  main  problem  are  pro- 
posed. 

a.     Quantization  in  the  A/fine  Plane 

In  the  original  algorithm  the  hash  table  can  be  considered  as  a  two 
dimentional  array  of  pointers,  each  pointer  points  to  the  entr\'  with  the  same  aOme  co- 
efficients.  Hence,  the  implementation  of  the  hash  table  is  essentially  quantization  of  the 
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Figure  6.       Hashing  functions  of  atan,  asinh,  and  tanh 
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affine  plane  with  infinite  number  of  bins  (or  buckets).  Each  bucket  in  the  hash  table  is 
indexed  by  the  quantized  coefTicients  {c,t]).  But,  the  original  approach  has  a  lot  of 
shortcomings  as  mentioned  before.  In  order  to  tolerate  the  noise  perturbation  on  the 
test  image,  a  quantization  with  finite  number  of  bins  is  necessar\\ 

Generally  speaking,  the  bigger  the  table  size,  the  better  the  spatial  resol- 
ution of  the  quantization.  However,  under  the  consideration  of  noise  perturbation  there 
is  actually  a  trade-off  between  the  total  number  of  bins  and  the  bucket  size.  Although 
using  a  smaller  total  number  of  bins  can  tolerate  more  noise  perturbation,  longer  linked 
lists  will  increase  the  accessing  time  of  the  hash  table.  If  the  quantization  bin  size  is 
reduced,  it  will  be  difficult  to  survive  in  the  presence  of  noise.  After  trying  many  bucket 
sizes  and  total  number  of  bins  in  different  cases,  the  same  conclusion  as  Costa,  Haralick, 
and  Shapirp  [Ref  4:  pp.  10-11]  was  reached,  i.e.,  there  is  no  optimal  hash  table  size  that 
can  work  well  for  all  data.   The  table  size  used  here  for  all  experiments  was  90  x  90. 

Before  spatial  sampling  the  afiine  plane,  the  bounds  for  both  the  coefficients 
(f  and  1/  should  be  known.  According  to  the  assumptions  made  in  the  first  section  of  this 
chapter,  the  maximun  and  minimum  values  of  the  affine  coefficients  can  be  calculated. 
Referring  to  Figure  7,  the  bounds  of  c  and  ?/  can  be  derived  as  follows. 

The  image  plane  has  a  spatial  resolution  of  512  x  512.  Points  a,  b.  c  make 
up  a  set  of  non-collinear  triplet,  and  p  is  an  arbitrary  point  on  the  same  plane.  In  order 
to  find  the  maximun  and  minimun  bounds  on  £  and  ?/,  the  worst  cases  shown  in 
Figure  7  are  considered.  Assume  A  is  the  area  of  the  input  object.  The  triplet  is  at  the 
lower  left  hand  corner,  and  the  arbitrary  point  is  at  the  upper  right  hand  corner  of  the 
image  plane  as  shown  in  case  (a).  In  case  (b)  the  position  of  the  triplet  and  the  arbitrary" 
point  are  reversed.  Let  the  magnitude  of  both  the  vector  ca  and  the  vector  cb  equal  to 
A  ,  which  equals  J-j-r  due  to  the  previous  restriction.  Using  equation  (2.5)  and 
equation  (2.6)  for  case  (a)  yields 
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Figure  7.        Calculation  of  the  hounds  of  affine  coefficient 


20 


and 


_  (512  -  0)(0  -  0)  -  (A  -  0X512  -  0) 

•smax  ~  '/max 
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-^12 


A 
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(2.11) 


Similarly  results  for  case  (b)  can  be  obtained.   Hence,  the  bounds 
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Having  the  bounds  on  ^,  >/  and  the  90  x  90  table  size,  it  is  possible  to  compute  the  bin 
width  A;  and  A;/  as  follows 
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b.     Improved  Hash  Structure 

Hashing  is  an  efTicient  technique  for  address  calculation.  Sometimes,  it  is 
also  called  a  randomizing  or  scrambling  method.  In  this  technique  the  item's  feature  is 
converted  into  a  near-random  number,  and  this  number  is  used  to  determine  where  the 
item  is  going  to  be  stored.  Within  the  hash  table  ever\'  item  is  associated  with  an  afilne 
coefficient  pair.  By  using  the  atan  hashing  function  and  the  90  x  90  spatial  quantization 
the  original  entr\"  index  {t,y^)  is  replaced  by  the  pair  (i.  j). 

In  the  remainder  we  discuss  how  to  use  the  index  (i,  j)  to  generate  the  entry 
key  and  how  to  convert  the  key  into  a  more  or  less  random  number  uniformly  distrib- 
uted in  the  hash  table.  In  the  following  discussion  the  entr}'  key  is  called  an  inkey,  and 
the  random  number  is  called  a  hashkey. 

Hj  Generation  of  inkey.  The  hash  table  is  a  two  dimentional  structure 
indexed  by  (i,  j),  and  an  inkey  is  a  one  dimentional  variable.  Conversion  of  (i,  j)  to  an 
inkey  will  cause  collision  of  entries.  In  order  to  reduce  this  kind  of  collision,  two  differ- 
ent one-to-one  functions  with  appropriate  operations  are  used.  For  simplicity,  the  inkey 
can  be  computed  in  the  following  equation  with  tan  30°  and  tan  20°  as  the  two  factors, 

inkey'  =  i  x  tan  30°  +J  x  tan  20°.  (2.16) 

The  two  terms  in  the  above  equation  are  two  diOerent  one-to-one  functions  so  that  i,  j 
in  the  equation  can  not  commute  with  each  other  and  keep  the  same  value  of  inkey'. 
Due  to  this  characteristic  the  number  of  collisions  in  the  hash  table  can  be  reduced.  On 
the  other  hand,  the  value  from  the  above  equation  is  a  real  number,  and  to  avoid  the 
trunction  error  this  number  is  multiplied  by  100  before  the  trunction.  Hence,  the 
equation  for  inkey  becomes 

inkey  =  trunc{inkey'  x  100).  (2.17) 
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(2)  Generation  of  hashkey.  Given  the  inkey,  it  can  be  converted  to  a 
hashkey.  There  are  many  key-to-address  conversion  algorithms,  such  as  mid-square 
method,  dividing,  shifting,  folding,  and  digit  analysis  ...  etc.  From  the  experimental 
conclusion  of  many  researchers,  the  best  choice  is  the  simple  division  method.  [Ref.  5] 
Using  this  method  the  inkey  is  divided  by  a  prime  number  u'hich  is  approxmately  equal 
to  or  less  than  the  number  of  the  total  hash  table  entries,  and  the  remainder  is  taken  as 
the  relative  bucket  number,  i.e.,  the  hashkey.  The  generation  of  inkey  and  hashkey  is 
illustrated  in  Figure  8. 

c.     Partial  Voting 

The  noise  sensitivity  problem  can  be  lessened  by  using  a  hash  table  where 
the  bucket  size  is  not  ver\-  fine.  The  table  size  chosen  was  90  x  90.  In  addition,  it  is  still 
possible  to  improve  the  matching  algorithm  by  using  the  partial  voting  technique.  In 
this  technique  eight-neighbor  mesh  as  shown  in  Figure  9  is  used  where  each  bin  has  the 
corresponding  voting  weight.  For  each  interesting  point  whose  quantized  affine  index 
is  (i.  j),  one  vote  is  counted  for  the  entries  (modelno,  tripletno)  associated  with  the 
bucket  (i,  j)  and  all  the  eight  neighbors  of  that  particular  bucket  will  also  receive  partial 
votes.  For  example,  entries  associated  with  bucket  (i-1,  j-1),  (i-1,  j+  1),  (i+  1,  j-1)  and 
{i+  1,  j-i- 1)  will  each  receive  a  0.25  vote;  entries  for  bucket  (i-1,  j),  (i.  j-1),  (i,  j+  1)  and 
(i+  1,  j)  will  each  receive  a  0.5  vote  [Ref  4:  pp.  11].  As  a  result  of  partial  voting  there 
will  be  some  false  peaks  appearing  in  the  two  dimentional  accumulation  voting  array. 
The  entr}'  which  received  the  maximun  votes  may  not  be  the  one  of  interest.  In  order 
to  get  rid  of  these  false  peaks  an  additional  verification  procedure  must  be  considered. 
The  verification  procedure  will  be  discussed  in  the  implementation  of  the  algorithm. 
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Figure  9.        Partial  voting  technique 


111.     ALGORITHM  IMPLEMENTATION 

From  the  discussion  of  the  previous  chapter  the  afTine  transformation  is  known  to 
be  a  ver\'  effective  method  for  object  detection  at  different  views,  although  a  great  deal 
of  computation  is  needed  in  the  process.  This  makes  the  affme  transformation  technique 
impractical  unless  the  complexity  can  be  reduced.  Hence,  the  algorithm  was  divided  into 
two  steps.  The  first  step  is  the  preprocessing  at  which  data-base  representation  of 
models  is  built.  This  step  does  not  involve  any  information  from  the  test  scene.  It  is 
executed  off-line  before  the  recognition.  The  second  step  is  the  recognition  at  which  the 
data-base  is  used  to  match  the  models  against  the  test  objects.  With  the  suggested 
two-step  scheme,  it  is  possible  to  keep  the  complexity  of  on-line  computations  low.  As 
discussed  in  the  previous  chapter  it  is  necessar\'  to  solve  some  major  problems  of  the 
algorithm,  such  as  the  basis  instability,  the  collision  of  the  hash  table,  and  the  noise 
sensitivity.  The  solutions  to  these  problems  were  proposed.  The  implementation  of  this 
improved  two-step  algorithm  is  discussed  in  the  following.  The  Pascal  source  code  of 
all  modules  is  listed  in  Appendix  A. 

A.     PREPROCESSING  (DATA-BASE  SETUP) 

This  ofT-line  step  has  four  modules  which  are  explained  separately.    The  operations 
of  the  preprocessing  step  are  shown  in  Figure  10. 
1.     Rule  Out  the  Undesired  Triplets 

This  module  solves  the  numerical  instability  problem  by  ruling  out  the  trouble- 
some triplets.   The  following  procedures  are  included. 
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Figure   10.        Flowchart  of  the  preprocessing  step 
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a.     COMBINA  TION 

This  is  a  recursive  procedure  which  generates  all  possible  combinations  of 
triplets  from  a  set  of  input  interesting  points.  If  there  are  m  interesting  points,  the  total 
number  of  combinations  will  be 


.m  ^  H^n-  l)(m  -  2) 
3! 


CT  =  — TT -'  0-1) 


For  each  combination  generated  this  procedure  will  call  the  SELECTION  procedure. 

b.  SELECTION 

This  procedure  screens  the  triplet  passed  from  the  COMBINATION  pro- 
cedure. If  the  area  of  this  triplet  is  less  than  one  twentieth  of  the  corresponding  model 
area,  it  will  be  bypassed  and  the  control  returned  to  the  COMBINATION  procedure  for 
a  new  triplet.  If  the  triplet  area  is  greater  than  or  equal  to  this  value,  then  the  control 
will  go  to  the  PERMUTATION  procedure.  Since  a  triplet  passing  the  area  test  is  also 
a  non-collinear  set,  no  additional  coUinearity  test  is  necessar\'  in  this  procedure. 

c.  PERMUTA  TION 

The  order  of  points  of  the  selected  triplet  is  important,  because  a  different 
order  of  the  same  triplet  can  generate  different  afilne  coefficients.  Hence,  this  procedure 
considers  all  the  permutations  of  the  selected  triplet,  i.e.,  ever>'  triplet  has  Pj  =  6  per- 
mutation cases. 

2.     Calculation  of  Affine  Coefficients 

For  a  given  triplet    <a,  b,  c>,  this  module  calculates  the  alTme  coefficients 
((f,  ?/)  of  all  other  points  p,  based  on  this  triplet,  that  is 


'? A      /(«x  -  U(^\  -  Cx)\ _ ,  /Px,  -  Cx 

.nj  \{ay-by){l\.-Cy)]  Kfy^-Cy 


^''■''  '  (3.2) 
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where  /=  1,  2,  3, ...,  m  —  3. 

According  to  the  above  equation  this  module  includes  several  matrix  operation 
modules.  The  INVERSE  computes  the  inverse  matrix  in  the  equation,  and  the 
MATRIX-MULT  multiplies  this  inverse  matrix  with  the  other  matrix  to  get  the  affme 
coefTicients  ^  and  tj. 

3.     Quantization  of  the  Affine  Plane 

In  order  to  tolerate  the  noise  perturbation,  a  90  x  90  table-size  was  used  based 
on  the  previous  discussion.  This  means  that  the  afilne  plane  can  be  divided  into  8100 
difierent  bins,  where  each  bin  is  indexed  by  (i,  j).  Two  procedures  are  called  in  this 
module,  namely,  SCATTER  and  QUANTIZATION. 

a.  SCA  TTER 

Before  quantization,  an  atan  was  used  as  the  hashing  function.  This  special 
function  can  scatter  the  affme  coefficients  c  and  rj  over  a  wide  range  in  the  affme  plane 
to  avoid  the  colUsion  in  hash  table  due  to  the  concentration  of  affme  coefficients.  So, 
the  scattered  afime  coelTicients  are 

J  =  alan{^)  (3.3) 

?/  =  atafi{rj).  (3.4) 

b.  QUANTIZA  TION 

From  equations  (2.12),  (2.13),  and  the  assumed  values  of  A,  it  is  possible 
to  calculate  the  bounds  on  the  affme  coefficients.  Since  a  90  x  90  table-size  was  used, 
the  quantization  index  (i,  j)  for  all  affine  coefficient  pairs  (cf ,  rj)  can  be  calculated  as  in 
the  following  : 


k\=-jz-  (3.5) 
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«=ir  <'■'' 


1    ,     .   1619  , 
where  A,!  =  Ar/  =  — 


90 


for  Ai  >0 


i  =  trunc{kl)  +  46  (3.7) 


for   Al  <0 


i  =  irunc{k\)  +  45  (3.8) 


for   A-2>0 


J  =  trunc{k2)  +  46  (3.9) 


for   A-2<0 


J  =  o-w/7c(A2)  +  45.  (3.10) 

4.     Hash  Table  Generation 

The  purpose  of  this  module  is  to  create  a  hash  table  which  can  be  stored  in  the 
data-base  to  identify  the  test  objects  from  the  scene.  There  are  three  procedures  in  this 
module  as  detailed  below. 
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a.  KEY-CONVERSION 

Since  the  two-dimensional  index  (i,  j)  is  not  a  numeric  key,  it  can  be  con- 
verted into  a  numeric  form  for  the  convenience  of  implementation.  The  conversion 
should  be  done  with  the  least  collision  of  entry  and  without  losing  information  in  the 
key.  Equation  {3. 11)  was  selected  to  meet  the  above  requirements.  This  procedure  uses 
it  to  generate  the  inkey. 

/«Ao;  =  rr«/7c[(/xtan30°+yxtan20')x  100].  (3.11) 

In  a  good  hash  table,  the  inkey  should  be  distributed  as  evenly  as  possible 
over  the  range  of  the  table  size.  The  KEY-CONVERSION  procedure  uses  the  simple 
method  of  division  to  convert  the  inkey  to  a  hashkey,  i.e., 

hashkey  =  inkey  rem  N.  (3-12) 

where  rem  is  the  operation  of  reminder  and  N  is  the  prime  number  that  is  approximately 
equal  to  or  less  than  the  size  of  the  hash  table. 

b.  HASHING 

To  setup  the  hash  table,  all  the  records  of  interesting  points  have  to  be  put 
into  the  table  as  entries  and  each  record  with  the  same  inkey  will  be  linked  by  pointers. 
The  HASHING  procedure  checks  to  see  whether  the  entr>'  in  the  hash  table  accessed 
by  the  hashkey  is  empty.  If  it  is,  then  insertion  of  this  input  record  into  the  hash  table 
will  be  done  right  away.   Otherwise,  it  will  invoke  the  COLLISION  procedure. 

c.  COLLISION 

The  link  field  of  ever\'  entr\'  in  the  hash  table  indicates  whether  the  entr>'  is 
occupied  or  not.  If  the  entry  is  empty,  its  link  field  was  set  to  -1.  If  the  accessed  entry 
in  the  hash  table  is  not  empty,  this  procedure  will  find  the  next  available  slot  for  the  in- 
put record.    Then,  it  will  put  the  relative  address  (hashkey)  of  the  new  slot  into  the  link 
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field  of  the  previous  one  which  has  the  same  inkey.  After  all  the  records  are  entered,  the 
hash  table  linked  by  pointers  is  established.  Figure  1 1  illustrates  the  structure  of  the 
hash  table. 

B.     RECOGNITION  (IDENTIFICATION  OF  TEST  OBJECTS) 

After  the  preprocessing  step  is  accomplished,  a  set  of  interesting  points  of  the  test 
objects  can  be  processed  to  identify  the  unknown  objects  in  the  recognition  step.  There 
are  three  modules  involved  in  this  off-line  step.  The  operation  of  the  recognition  step 
is  shown  in  Figure  12.   The  following  is  a  discussion  of  these  steps. 

1.  Calculation  of  Input  Data 

This  step  is  similar  to  part  of  the  preprocessing  step  except  that  there  is  a  dif- 
ference in  the  hash  table.  Here,  only  input  affme  coefficients  based  on  stable  basis 
triplets  need  to  be  calculated.  Since  the  noise  perturbation  is  inevitable  in  the  input 
image,  sensitivity  is  an  important  issue  here.  In  order  to  ensure  the  tolerance  to  a  noisy 
environment,  the  criterion  factor  1/20  of  the  area  in  the  SELECTION  procedure  of  the 
preprocessing  step  was  replaced  by  the  factor  1,10.  The  triplet  area  should  be  at  least 
1  10  of  the  total  area  of  the  test  object,  otherwise  the  triplet  will  be  rejected.  The  output 
of  this  module  is  a  data  file  called  lally.   Figure  13  shows  the  structure  of  the  tally  file. 

2.  Affine  Matching 

This  matching  module  is  an  important  part  in  the  recognition  procedure.  Partial 
voting  technique  was  implemented  to  generate  all  the  candidate  data.    The  following  is 
a  discussion  of  the  procedures  included  in  this  module. 
a.     PARTIAL  VOTING 

For  a  given  interesting  point,  this  procedure  checks  all  the  nearby  affine 
coefficients  in  the  tally  file.  After  quantization,  ever\^  affine  coefficient  pair  {^,n)  be- 
longs to  a  corresponding  bucket  indexed  by  (i,  j).  Therefore,  the  matching  procedure  is 
nothing  but  a  mapping  between  the  tally  file  and  the  hash  table.    If  there  is  a  match, 
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even'  entr>'  associated  with  the  bucket  (i,  j)  will  receive  one  vote.  Since  the  partial  voting 
technique  was  used  to  tolerate  the  noise  perturbation,  the  eight  neighbors  of  the  bucket 
(  i  ,  j  )  will  receive  partial  votes,  i.e.,  entries  associated  with  buckets  (i-1,  j-1),  (i-1,  ]+  1), 
(i+  1.  j-1)  and  (i+  1,  j+  1)  will  receive  a  0.25  vote;  entries  associated  with  buckets  (i-1, 
j).  (i,  j-1),  (i,  j+  1)  and  (i+  1,  j)  will  receive  a  0.5  vote. 

When  all  the  entries  in  the  tally  file  are  matched  in  the  procedure,  the  cor- 
responding voting  array  of  the  affine  coefficient  pair  will  accumulate  all  the  votes  it  has 
gotten  during  the  campaign.  In  ideal  noise-free  case,  the  entry  that  received  the  maxi- 
mum votes  indicates  an  exact  matching  between  the  test  object  and  the  data-base  model. 
But  in  the  noisy  case,  the  result  is  different.  In  the  latter  case  partial  voting  technique 
was  applied  to  reduce  the  noise  perturbation  problem.  It  is  evident  that  some  voting 
array  bins  will  receive  extra  votes  due  to  the  multiple  voting.  Some  false  peaks  may 
appear  in  the  voting  array  as  the  by-product  of  the  partial  voting  technique.  Therefore, 
the  entr\'  which  received  the  maximum  votes  may  not  be  the  desired  candidate.  This 
kind  of  problem  will  be  treated  in  the  following  procedures. 
b.     TOP-SIX-MAX 

One  way  to  solve  the  false  peak  problem  is  to  conduct  additional  tests  on 
all  the  entries  after  partial  voting.  But,  it  is  impractical  because  of  the  long  processing 
time.  Another  approach  is  proposed  based  on  the  fact  that  the  false  entries  may  some- 
times receive  maximum  vote,  but  the  true  ones  should  have  votes  close  to  the  false  peak. 
Based  on  the  experimental  experience,  the  first  six  highest  number  of  votes  are  chosen 
to  select  the  suited  entries  in  the  hash  table.  This  procedure  essentially  finds  the  top  six 
maximum  number  of  votes. 
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c.  ALL-MAX-SELECTION 

In  this  procedure  all  the  entries  which  satisfy  the  above  criterion  will  be  se- 
lected. Since  only  a  small  amount  of  entries  will  be  checked  instead  of  all  the  ones  in  the 
next  procedure,  this  method  can  save  a  lot  of  operation  time  in  the  recognition  step. 

d.  CHECK 

This  CHECK  procedure  will  test  all  the  entries  sent  from  the 
MAX-SELECTION  procedure.  After  all  the  redundant  entries  are  deleted,  the  appro- 
priate ones  are  picked  by  going  through  a  TEST  sub-procedure  included  in  th'S  module. 
The  qualified  entries  can  be  considered  as  the  candidate  data. 

3.  RECONSTRUCTION 

This  module  does  the  inverse  afTme  transformation  to  calculate  all  the  interest- 
ing point  sets  of  the  quahfied  candidate  triplets. 

4.  VERIFICATION 

Since  not  all  the  candidate  interesting  point  sets  are  correct,  the  purpose  of  this 
module  is  to  check  all  those  interesting  point  sets  until  finding  the  correct  one.  Finally, 
the  identified  images  will  be  displayed  on  the  screen. 


37 


IV.     EXPERIMENTAL  RESULTS  AND  PERFORMANCE 

Presented  in  this  chapter  are  the  computer  simulation  results  and  the  experimental 
performance  of  the  improved  afilne  invariant  matching  algorithm.  These  experimental 
tests  reconfirmed  the  affme  invariance  of  this  algorithm.  It  also  showed  the  improved 
noise  characteristic  which  is  the  main  problem  of  the  original  algorithm.  Since  our  study 
is  concentrated  on  the  algorithm  improvement,  models  and  test  objects  were  generated 
artificially  in  the  computer.  There  are  two  different  sets  of  data  used  in  the  experiments. 
For  the  convenience  of  explanation,  the  first  set  is  referred  to  as  SET  I  which  consists 
of  two  simple  objects,  and  the  second  one  is  referred  to  as  SET2  which  consists  of  two 
complicated  objects.    Figure  14  shows  these  two  sets  of  models. 

A.     NOISE-FREE  TESTS 

First,  an  ideal  noise-free  situation  is  considered.  The  model  objects  in  SETl  and 
SET2  are  undergone  similarity  transformation.  Occlusion  is  also  evident  in  the  test  ob- 
jects. The  main  objective  is  to  check  the  affine  invariant  characteristics  of  the  algorithm, 
i.e.,  rotation,  translation,  and  scaling.  The  abiUty  to  detect  occluded  object  will  also  be 
tested. 

1.  Similarity  Transformation  Test 

The  unknown  test  object  of  SETl  is  used  as  the  input  of  the  algorithm.  The  test 
object  and  the  recognized  object  of  SETl  are  shown  in  Figure  15.  Figure  16  shows  the 
same  kind  of  test  for  SET2.  This  is  a  case  where  the  recognition  of  models  from  the  test 
objects  with  rotation,  translation,  and  scaling  are  demonstrated. 

2.  Occlusion  Test 

A  composite  overlapping  scene  consists  of  two  different  test  objects  can  be 
identified  through  the  affme  invariant  matching  algorithm.     Furthermore,  one  vertex 
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Figure   14.       Data-base  models  of  SETl(above)  and  SET2(belo>v) 


39 


Ficiiie   15.       Siniilaritv  transform  test  of  SETl 


4U 


rigine   16.       Similarity  transform  test  of  SET2 
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point  of  the  polygonal  shape  is  missing  for  the  test  objects  of  SET  I  shown  in 
Figure  17.  Two  polygonal  vertices  for  the  test  objects  of  SET2  are  also  missing  in  Fig- 
ure 18.  The  test  results  of  SETl  and  SET2  are  also  shown  at  the  bottom  in  Figure  17 
and  Figure  18,  respectively.  From  the  reconstructed  results  of  SETl  and  SET2,  it  is 
obvious  that  the  hidden  vertices  of  the  test  objects  in  both  cases  can  still  be  recognized 
because  of  the  special  characteristic  of  the  algorithm. 

B.     NOISE  PERTURBATION  TESTS 

In  this  section  the  test  objects  will  be  identified  in  scenes  with  noise  perturbations. 
In  usual  situations  a  filter  can  be  apphed  to  remove  most  of  the  noise.  But  in  reality, 
some  vertex  points  will  still  have  small  errors  after  the  extraction  procedure.  It  was 
noted  in  the  previous  chapters  that  the  afTine  invariant  matching  algorithm  was  very 
rigid  in  calculating  the  coefficients  ^  and  rj.  If  the  coordinates  of  some  vertex  points 
changed  a  little  in  the  presence  of  noise,  the  affine  coefficients  based  on  these  noisy  co- 
ordinates would  deviate  from  the  true  positions  in  the  afiine  plane.  Even  if  the  error  of 
the  extraction  is  very  small,  it  can  cause  the  original  recognition  step  to  fail.  This  is  due 
to  the  erroneous  matching  occurred  in  the  hash  table. 

The  tests  conducted  in  this  section  showed  the  noise  tolerance  of  the  improved  al- 
gorithm. According  to  the  limits  of  the  the  affine  plane  resolution  and  the  mask  size  of 
the  partial  voting,  the  allowable  maximum  error  in  the  vertex  extraction  is  about  ,,  2  . 
This  means  that  the  error  region  of  the  interesting  point  is  a  circle  with  a  center  on  the 
point  and  a  radius  equals  to  ^2  as  shown  in  Figure  19.  The  variation  of  the  vertex 
may  fiill  inside  or  on  the  circle.  In  the  following  tests  only  the  worst  cases  are  consid- 
ered, i.e.,  the  test  objects  are  occluded  and  some  of  its  interesting  points  are  disturbed 
by  the  noise. 

Figure  20  shows  the  plot  of  the  test  objects  of  SETl  with  four  interesting  points 
disturbed.    Figure  21  shows  the  recognition  of  SETl  with  four  interesting  points  dis- 
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Figure   17. 


Occluded  objects  test  of  SETl 


43 


rigiire   IS. 


Occluded  objects  test  of  SET2 
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ri<;ure   19. 
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Figure  20.        Plot  of  the  test  objects  of  SETl  ^^ith  four  interesting  points  disturbed 
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Figure  21.       Recognition  of  SCTl  ^^itll  four  interesting  points  disturbed 
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turbed.  Figure  22  shows  the  plot  of  the  test  objects  orSET2  with  six  interesting  points 
disturbed.  Figure  23  shows  the  recognition  of  SET2  with  six  interesting  points  dis- 
turbed. Figure  24  shows  the  plot  of  the  test  objects  of  SET!  with  seven  interesting 
points  disturbed.  Figure  25  shows  the  recognition  of  SET  1  with  seven  interesting  points 
disturbed.  Figure  26  shows  the  plot  of  the  test  objects  of  SET2  with  ten  interesting 
points  disturbed.  Figure  27  shows  the  recognition  of  SET2  with  ten  interesting  points 
disturbed. 

C.     PERFORMANCE 

By  inspecting  the  results  of  our  experimental  tests,  it  is  evident  that  almost  all  of  the 
limitations  of  the  original  affme  matching  algorithm  have  been  improved.  The  old 
problems  include  the  numerical  instability,  the  coUision  of  hash  table,  and  the  noise 
sensitivity.  Since  the  modified  hash  structure  was  used,  the  problem  of  hash  table  colli- 
sion due  to  nonuniform  hashkeys  was  greatly  reduced.  Consequently,  about  1300  ms 
of  CPU  time  was  saved  in  the  recognition  step  of  the  noise  free  tests.  Initially,  the  ori- 
ginal algorithm  is  verv'  sensitive  to  noise  and  fails  in  noisy  tests.  In  order  to  increase  the 
tolerance  to  noise  perturbation,  a  quantized  alTine  plane  with  90  x  90  resolute  cells  was 
chosen.  After  the  quantization,  the  partial  voting  technique  was  also  used  to  select  all 
the  quaUfied  candidate  triplets.  Finally,  in  the  verification  procedure  the  identified 
object{s)  was  displayed  on  the  screen.  For  the  improved  algorithm  the  noise  tolerance 
is  enhanced  by  a  factor  of  70°o,  i.e.,  even  when  seventy  percent  of  the  interesting  points 
of  the  test  object  are  disturbed,  the  improved  algorithm  can  still  identify  the  test  objects. 

There  is  a  trade-off  between  the  processing  speed  and  the  noise  tolerance.  To  have 
more  noise  tolerance,  the  partial  voting  technique  is  used.  This  will  decrease  the  speed 
and  increase  the  complexity  of  the  algorithm.  Therefore,  the  processing  speed  of  the 
improved  algorithm  is  still  highly  dependent  on  the  number  of  interesting  points  in  the 
test  object.    Another  existing  limitation  of  the  algorithm  is  that  only  objects  with  small 
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I I  original  test  objects 

Y/A  distorted  test  objects 


Figure  22.       Plot  of  the  test  objects  of  SE 72  \\\\\\  six  interesting  points  disturi)ed 


49 


Figure  23.       Recognition  of  SC T2  \\ith  sLx  interesting  points  disturbed 
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original  test  objects 


y^A  distorted  test  objects 


Figure  24.       Plot  of  the  test  objects  of  SETl  >>ith  seven  interesting  points  disturbed 
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Figure  25.       Recognition  of  SLI  1  "ith  seven  interesting  points  disturbed 
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Figure  26. 


Plot  of  the  test  objects  of  SET2  \>ith  ten  interestiiig  points  disturbed 
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Figure  27.       Recognition  of  SET2  >\ith  ten  interesting  points  disturbed 
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number  of  vertices  are  handled  here.  Additionally,  the  system  developed  here  can  not 
be  applied  to  patterns  with  concave  boundary  curves.  However,  the  algorithm  can  be 
extended  in  these  cases  by  using  the  footprint  method  proposed  by  Hummel  and 
Wolfson  [Ref  3]. 

D.     EXPERIENCE  GAINED 

The  experience  gained  in  this  study  can  be  summarized  as  follows. 

1.  Numerical  Instability 

When  the  interesting  points  of  a  triplet  are  too  close  to  each  other,  the  afilne 
coefficients  calculated  based  on  this  triplet  tend  to  be  unstable.  This  undesirable  situ- 
ation can  be  avoided  by  applying  the  area  test  criteria  in  both  the  Preprocessing  and  the 
Recognition  steps. 

2.  Hashing  Function 

The  values  of  c  and  t]  tend  to  concentrate  highly  around  the  origin  of  the  afTine 
plane  because  they  are  all  small  numbers.  These  small-valued  coefficients  will  generate 
many  long  hnked  lists  in  the  hash  table.  Hence,  the  accessing  time  will  increase  and 
become  impractically  long.  Both  the  Hnear  and  non-linear  hashing  functions  were  tested 
in  the  experiments.  The  results  show  that  the  non-linear  atan  function  is  the  best  among 
many  hashing  functions.  This  function  can  scatter  the  small  afime  coefficients  evenly 
over  a  wide  range  of  the  affine  plane.  Consequently,  the  size  of  the  linked  hst  can  be 
reduced  and  a  desirable  processing  speed  can  be  achieved. 

3.  Quantization  of  Affine  Plane 

In  order  to  tolerate  the  noise  perturbation  on  the  test  objects,  coarser 
quantization  of  affine  plane  is  desirable.  After  calculating  the  bounds  on  ^  and  ?/,  an 
appropriate  table  size  was  chosen  to  implement  the  hash  table.  But,  there  is  no  optimal 
hash  table  size  that  can  work  well  for  all  kinds  of  data.  In  our  experimental  tests  a  90 
X  90  table  size  was  selected. 
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4.  Modified  Hash  Structure 

After  quantization,  every  entry  in  the  hash  table  is  indexed  by  (i,  j).  This  tvvo- 
dimentional  index  is  not  a  numeric  key,  it  needs  to  be  converted  into  a  numeric  value  to 
implement  the  one-dimentional  hash  table.  liowever,  this  kind  of  conversion  will  induce 
multiple  colUsions  in  the  hash  table.  In  order  to  reduce  these  coUisions,  two  different 
one-to-one  functions  were  adopted  to  generate  the  numerical  inkey. 

5.  Partial  Voting  Technique 

The  noise  problem  can  be  lessened  by  using  a  coarser  quantization  of  the  affme 
plane.  In  addition,  it  is  possible  to  improve  the  original  matching  algorithm  by  applying 
the  partial  voting  technique.  For  ever\'  quantized  afTme  index  (i,  j),  there  is  a  corre- 
sponding eight-neighbor  mesh  where  each  bin  has  a  different  voting  weight.  This  tech- 
nique can  increase  the  noise  tolerance  in  the  recognition  step. 

6.  False  Peaks  of  Voting  Array 

As  a  result  of  the  partial  voting,  the  aflnie  invariant  matching  algorithm  suffers 
from  the  false  peaks  in  the  accumulation  array.  The  entry  which  received  the  maximum 
votes  may  not  be  the  correct  one.  To  overcome  this  problem,  the  top  six  maximum 
votes  are  chosen  as  the  candidates.  By  going  through  the  verification  procedure  the 
correct  candidate  can  be  selected. 

7.  Noise  Perturbation 

The  original  algorithm  is  very  rigid  in  calculating  the  afTme  coefficients.  Hence, 
it  is  ver}"  sensitive  to  noise  perturbation.  From  the  experimental  results  of  the  improved 
algorithm,  the  noise  tolerance  shows  an  increase  of  10%  with  respect  to  the  original 
method. 

8.  Speed  and  Complexity 

In  noise  free  cases,  the  improved  matching  algorithm  can  achieve  a  higher  speed 
than  the  original  one  when  deahng  with  more  complicated  images.    In  noisy  cases,  the 
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speed  deteriorates  due  to  the  execuation  of  partial  voting.  But,  in  both  cases  the 
execualion  time  of  the  improved  algorithm  is  still  highly  dependent  on  the  number  of 
interesting  points  involved  in  the  test. 
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V.     CONCLUSIONS  AND  FUTURE  RESEARCH 

The  object  recognition  is  a  major  and  difficult  task  in  computer  vision.  The  afTine 
invariant  matching  technique  proposed  by  Hummel  and  Wolfson  is  a  new  and  interest- 
ing method  for  recognizing  flat  objects  in  a  perspective  projection  image.  Since  the  re- 
cognition of  partially  occluded  objects  is  the  main  concern,  the  local  point  feature  was 
used  in  the  afTme  invariant  matching  algorithm.  In  order  to  reduce  the' complexity  of 
the  algorithm,  a  two-step  scheme  was  applied.  The  algorithm  was  divided  into  two  dif- 
ferent steps,  the  off-line  preprocessing  step  and  the  on-line  recognition  step. 

This  thesis  discusses  the  shortcomings  that  occurred  in  the  original  algorithm.  They 
are  the  basis  instability,  the  collision  of  hash  table,  and  the  noise  problem.  These 
shortcomings  make  the  original  matching  algorithm  impractical  to  deal  with  real  images. 
The  original  algorithm  was  improved  by  introducing  several  modifications.  The  area  test 
criteria  were  used  to  get  rid  of  unsuitable  triplets  to  avoid  numerical  errors.  The  modi- 
fied hash  structure  clearly  improved  the  collision  problem  of  the  hash  table.  The  partial 
voting  technique  with  the  consideration  of  false  peaks  in  the  voting  array  increased  the 
noise  tolerance  of  the  original  algorithm.  Finally,  it  was  shown  that  the  results  obtained 
from  the  improved  algorithm  are  much  better  than  the  results  from  the  original  method. 

Possible  subjects  for  future  study  related  to  affine  invariant  matching  could  be  : 

•  From  the  probability  point  of  view,  set  up  an  optimal  model  to  improve  the  re- 
cognition performance  for  noisy  objects. 

•  Use  the  footprint  method  to  implement  the  afTine  invariant  curve  matching. 

•  Extend  the  afline  invariant  matching  to  handle  3-D  object  recognition. 
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Design  special  purpose  hardware  to  achieve  parallel  searching  of  multiple  objects 
in  real  time. 


59 


APPENDIX  A.     PASCAL  SOURCE  CODE 


This  appendix  contains  the  Pascal  source  code  used  in  the  improved  afTine  matching 
system.  Explanation  of  each  of  the  modules  are  discussed  in  Chapter  III.  Some  proce- 
dures in  these  programs  are  adapted  from  the  original  implementation  (Ref  6]. 

iV'jV'jV'j'fs'oV'jVyf  ■jV'jViV'jViV'sV'sViV'jV-jV'sV'jV'jV'sV'jV'jV-jViV     PRE  PROCE  SSI  NG    'ViViViV'jVVf  ■jViViViViV'jV'jV'iVVr'jVVf  ■sViViViViV'jV'iV'jV'jV'sV'iViV'ilr'jV'jV 
■sVVfVfiV'sVV-Vr'sV'jVVfsV'sVVfiViV'jV'jVVr'sV'sV'j'fjV'jViV'jV     (Off-  line    Step)     ^ViV'sV'sV-V-sViViV'sVi'fjV'jViV-VVoV'j'oV'jV'jV'jV'jViV'jV'sViViV'jV'iViV'jV 

program  mode l_gen( output); 

("  This  module  generates  the  interesting  points  of  data-base  models, 

SETl  is  used  as  the  example  ''O 
(*  o/p  :  model_interesting_point  data  file  *) 
type 

ary  =  array  [1..  2,1..  50]  of  integer; 
var 

i, j ,modelno, interestingno  :  integer; 
output  :  text; 
x,y  :  ary; 
begin 

open(output, 'model_interesting_point. dat' , history  :=  new); 
rewrite (output); 
(->  model  1  *) 

interestingno  :=  9; 
x[  1,2]  :=  36;  x[  1,3] 
x[l,6]  :=  50;  x[l,7] 


modelno   :  =    1 


x[l,l] 
x[l,5] 
x[l,9] 

y[i,i] 
y[i,5] 
y[i,9] 


=  32 
=  48 
=  44 
=  30 
=  30 
=   62 


=   38;    x[l,4] 
=  52;    x[l,8] 


=  40; 
=  56; 


y[l,2]     :=   30;    y[l,3]     :=   28;    y[l,4] 
y[l,6]     :=   28;    y[l,7]     :  =   30;    y[l,8] 


=  30; 
=  30; 


writeln( output , modelno, interestingno); 

for  i  : =  1  to  interestingno  do 
writeln(output  ,x[  1 ,  i]  ,y[  1 ,  i]  ); 
(''f  model  2  -) 

modelno  :=  2;  interestingno  :=  7; 

x[2,l]     :=   20;    x[2,2] 

x[2,5]    :=   15;    x[2,6] 

y[2,l]    :=  31;    y[2,2] 

y[2,5]    :=  50;    y[2,6] 

writeln(output , modelno, interestingno); 

for    i    : =   1    to   interestingno   do 
wr iteln( output  ,x[  2 ,  i]  ,y[  2,  i]  ); 

close(output); 
end. 


=  21;    x[2,3] 

=   21 

x[2,4] 

:=   25; 

=   19;    x[2,7] 

=   19 

=  32;    y[2,3] 

=  40 

y[2,4] 

:=  50; 

=  40;    y[2,7] 

=   32 

^•itirrhiciti^-i'T-!r-;'^i^i(-^i(-i(ir-^i!i^-)'r->'(-h-ir'f^-^-h-^r-f!ir'^^-ic-!c'\ic'icic'ft-ic':!cicicici('!ciciti(ie 


program  model_af f ine_calculation( input , output); 

("  This  module  rules  out  the  undesirable  triplets  and  finds  all  the 
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affine  coefficient  pair  of  data-base  models  *) 
(*  i/p  :  model_interesting_point  data  file 

o/p  :  model_af f ine_coef f icient  data  file  *) 
const 

total  =  9999; 

areal  =  392.  0; 

area2  =  76.  0; 
type 

ary  =  array  [  1.  .  total]  of  integer; 

aryl  =  array  [1..2,1,  .2]  of  real; 

ary2  =  array  [  1.  .  3]  of  integer; 

ary3  =  array  [1..2,1..1]  of  real; 

ary4  =  array  [1..2,1.  .2]  of  integer; 
var 

count , i,j ,k, index  :  integer; 

outmodelnojoutinterestingno  :  array  [ 1. . 10]  of  integer; 

modelno, tripletno, interestingno, table_size  :  integer; 

x,y,rest_basex,rest_basey  :  ary; 

inverse_matrix  :  aryl; 

baseXjbasey, comx, corny  :  ary2; 

diff, coord  :  ary3; 

base_matrix  :  ary4; 


procedure  inatrix_mult(  inverse_matrix 

var  diff J  coord 


const 

k  = 

2 

1  = 

2 

m  = 

1 

var 

i,i 

1,1 

a   :  integer; 

begin 

for 

i 

:=  1  to  1  do 

for 

il  : =  1  to  m 

do 

c 

Dord[  i,  il]  :  = 

0; 

for 

i 

:=  1  to  1  do 

for 

il  : =  1  to  m 

do 

f 

or  n  : =  1  to 

L  do 

coord[  i,  il]  : 

=  coord[ i 

,il] 

+ 

di 

ff[n. 

il]; 

end; 

aryl; 
ary3); 


inverse_matrix[ i,n]  * 


aryl); 


procedure  inverse(base_matrix  :  ary4 

var  inverse_matrix 
var 

det  :  real; 
begin 

for  i  : =  1  to  2  do 

det   :=   (base_matrix[  1, 1]    *  base_matrix[  2,2]  ) 
(base_matrix[  1,2]    ^^  base_matrix[  2  , 1]  ); 
if   (det   <>   0.  0)    then 
begin 

inverse_matrix[  1 , 1] 
inverse_matrix[  1,2] 
inverse_matrix[  2 , 1] 
inverse_matrix[  2 , 2] 


=  base_matrix[ 2,2] /det; 
=  base_matrix[  1 ,2]    "'"   (-1)    /det; 
=  base_raatrix[  2,1]    ■>''   (-1)    /det; 
=  base_matrix[  1, 1]    /det; 
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end; 


end; 


procedure  calculate_coord(basex,basey  :  ary2); 
var 

i,m,il,i2,i3  :  integer; 
begin 

for  i  :=  1  to  2  do 
begin 

base_matrix[  1,  i]    :=  basex[  i]    -  basex[  i+1]  ; 
base_matrix[  2,  i]    :=  basey[  i]     -   basey[  i+1]  ; 
end; 
inverse(base_matrix,inverse_matrix); 
i2    :=    1; 

for   i   : =   1   to   interestingno  do 
begin 

if  ((basex[l]    <>  x[  i]  )   or   (basey[  1]    <>  y[i]))   and 
((basex[2]    <>  x[  i]  )    or   (basey[2]    <>  y[i]))    and 
((basex[3]    <>  x[  i]  )   or   (basey[3]    <>  y[i]))    then 
begin 

rest_basex[  i2]    :  =  x[  i]  ; 
rest_basey[  i2]    :=  y[  i]  ; 
i2   :=   i2  +   1; 
end; 
end; 
for   i   : =   1   to   ( interestingno[ 3)    do 
begin 

diff[l,l]    :=  rest_basex[  i]     -   basex[  3]  ; 

diff[2,l]    :=  rest_basey[  i]     -   baseyj  3]  ; 

mat r ix_mu  1 1 (  inver s e_inat r ix ,  d i f  f ,  coord) ; 

count   :=  count  +1; 

i3  :=  count  mod  ( interestingno-3); 

if  i3  =  1  then  tripletno  : =  tripletno  +  1; 

write (output , mode Ino, tripletno, coord[ 1, 1] ,coord[ 2,1] ); 
for  il  : =  1  to  3  do 

write(output  ,basex[  il]  ,basey[  il]  ); 
writeln( output ) ; 
end; 
end; 


procedure  perm(basex,basey  :  ary2; 

k  :  integer); 
var 

i,tx,ty  :  integer; 
begin 

if  k  =  3  then 

calculate_coord(basex,basey) 
else 

for  i  : =  k  to  3  do 
begin 

tx   :  =  basex[  i]  ; 
ty  :  =  baseyi  i]  ; 


basex[  i] 
baseyi  ij 
basex[  k] 
basey[  k] 


=  basex[  k]  ; 
=  baseyi  k]  5 
=  tx; 

=  ty; 
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perm(basex,basey,k+l); 
end; 
end; 

procedure  area_test(comx, corny  :  ary2; i  :  integer); 
var 

s ,a,bjC,sarea,area  :    real; 
begin 

a   :  =  sqr(comx[  2]  [  comx[  1]  )+sqr(  corny [  2]  ]  cotiiy[  1]  ); 

b   :  =  sqr(con:ix[  3]  [  comx[  2]  )+sqr(comy[  3]  ]  comy[  2]  ); 

c   :=  sqr(comx[  1]  [  comx[  3]  )+sqr(comy[  1]  ]  corayi  3]  ); 

a   :  =  sqrt(a); 

b    : =   sqrt(b); 

c   :  =  sqrt(c); 

s    :=   (a  +  b  +  c   )/2.  0; 

if  i  =  1  then  area  :=  areal; 

if  i  <>  1  then  area  : =  area2; 

sarea  :=  S"(s-a)*(s-b)*(s-c); 

sarea  :=  sqrt(sarea); 

area  : =  area/20. 0; 

if  (sarea  >  area)  then 
perm( comx , corny , 1 ) ; 
end; 


procedure  comb(k, index, j  :  integer); 
var 

i  :  integer; 
begin 

if  index  >  3  then  area_test( comx, corny, j) 
else 

for  i  : =  k  to  interestingno  do 
begin 

comx[  index]    :  =  x[  i]  ; 
comyi  index]    :  =  y[  i]  ; 

j   :=  j; 

corab( i+1 , index+1 , j ) ; 
end; 
end; 

beginC'^  main  *) 

open( input , 'model_interesting_point.  dat' , history  :=  old); 
reset( intput); 

open(output, 'model_affine_coefficient. dat' , history  :=  new); 
rewrite( output); 
table_size  :=  0;j:=  1; 
while  not  eof( input)  do 
begin 

readln( input ,outmodelno[ j] ,outinterestingno[ j] ); 

modelno  :=  outmodelno[ j] ; 

interestingno  :=  outinterestingno[ j] ; 

for  i  : =  1  to  interestingno  do 
readln(  input  ,x[  i]  ,y[  i]  ); 

count  :  =0;  tripletno  :  =  0;  j  :=  j  +  1; 

comb( 1 , 1 , modelno); 

table_size  :=  table_size  +  count; 
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end; 
writeln(output ,table_size,outmodelno[ 1] ,outinterestingno[ 1] , 

outraodelno[ 2]  ,outinterestingno[  2] ); 
close( input); 
close(output); 
end. 

program  mode l_inkey ( input , output ) ; 

i*   This  module  quantizes  the  affine  plane  into  8100  different  bins  and 

converts  each  bin  index  (i,  j)  to  an  inkey  *) 
{*   i/p  :  model_af f ine_coef f icient  data  file 

o/p  :  inkey  data  file  ''f) 
type 

inrec  =  record 

modelno, tripletno  :  integer; 
keyl,key2  :  real; 

basexl jbaseyl ,basex2,basey2,basex3,basey3  :  integer 
end; 
var 

b  :  inrec; 

inf ile,outf ile  :  text; 

kl ,k2,dk, inkeyl  :  real; 

i, j , il ,j 1, size, prim, inkey  :  integer; 

procedure  prirae(var  a  :  integer); 
var 

i,b  :  integer; 
begin 

b  :=  trunc(a/2); 
for  i  : =  2  to  b  do 
begin 

if  (a  mod  i)  =  0  then 
begin 

a  :  =  a-1; 
prime(a); 
end; 
end; 
end; 

begin("''  main  *) 

open  ( input , 'model_affine_coeff icient. dat ' , history:  =old); 

reset( input); 

open  (output , ' inkey. dat' , history:  =new); 

rewrite (output); 

jl  :=0; 

while  not  eof( input)  do 

begin 

readln( input); 
jl  :=  jl+1; 

end; 
close( input); 

open  ( input , ' model_affine_coeff icient. dat ' jhistory:  =old); 
reset( input); 
il  :=  1; 
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dk  :=  2.  0*arctan(20.  0)/90.  0; 
size  :  =  j  1  -  1; 
prim  :  =  size; 
prirae(prim); 

writeln( output , s  ize ,prim) ; 
while  il  <>  jl  do 
with  b  do 
begin 

readln( input , mode Ino , tripletno , key 1 , key 2 , 

basexl,baseyl,basex2,basey2,basex3,basey3); 
kl  :=  arctan(keyl)/dk; 
k2  :=  arctan(key2)/dk; 
if  (kl  >=  0. 0)  then 
begin 

i  :=  trunc(kl)  +  46; 
if  (i  >  90)  then  i  : =  90; 
end;  >?.•'  .. 

if  (kl  <  0. 0)  then 
begin 

i  :=  trunc(kl)  +  45; 
if  (i  <  1)  then  i  :=  1; 
end; 
if  (k2  >=  0.  0)  then 
begin 

j  :=  trunc(k2)  +  46; 
if  ( j  >  90)  then  j  : =  90; 
end; 
if  (k2  <  0. 0)  then 
begin 

j  :=  trunc(k2)  +  45; 
if  (j  <  1)  then  j  : =  1; 
end; 
inkeyl  :=  (0.  839'U  +  0.  364^vj  ),vioO; 
inkey  :=  trunc( inkeyl); 

writeln( output ,  inkey,  '  ':2,i:2,'  ' :  2  ,  j:  2  ,raodelno:  2  , 
tripletno,keyl,key2,basexl,baseyl,basex2, 
basey2 ,basex3 ,basey3); 
il  :=  il+1; 
end; 
close( input); 
close(output); 
end. 

program  hashing( input , output); 

('f  This  module  uses  the  inkey  to  generate  the  hashkey  and  sets  up 

the  hash  table  -) 
(*  i/p  :  inkey  data  file 

o/p  :  hash_table  data  file  *) 
const 

database_modelno  =  2; 
type 

rec  =  record 

inkey ,i ,j ,modelno, tripletno, link  :  integer; 
keyl,key2  :  real; 
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basexl,baseyl,basex2,basey2,basex3,basey3  :  integer; 

end; 
outrec  =  record 

hashkey , inkey , i, j ,modelno,tripletno, link  :  integer; 

keyl,key2  :  real; 

basexl,baseyl,basex2,basey2,basex3,basey3  :  integer; 

end; 
var 

a  :  array[0.  .  99999]  of  outrec; 

b  :  rec; 

il , i2, j 1 , j2,k2 , table_size,prim  :  integer; 

outmodelno,outinterestingno  :  array  [ 1. . database_modelno]  of  integer; 

c  :  array[  0.  .  99999]  of  integer; 


procedure  print; 
var 

i2  :  integer; 
begin 

for  i2  : =  0  to  table_size  -  1  do 
begin 

if  a[ i2] . hashkey  <>  -  1  then 
with  a[  i2]  do 

writeln(  output , hashkey ,  inkey ,  '  ':2,i:2,'  ':2,j: 
. ^  modelno:  2, trip let no:  4,keyl ,key2 ,basexl: 


2.' 
4, 


2, 


end; 


end; 


baseyl:  4,basex2:  4,basey2:  4,basex3:  4,basey3:  4, link) 


'I  L'ocedure   collision( var  m,n 
begin 

link  <>  -  1  do 

.  link; 


integer); 


while  a[  m]  . 
m  :  =  a[  m] 
n  :  =  m  +  1 
while  a[  n]  . 
begin 

n  :  =  n+1; 
if  n  >  table_size 
end; 


hashkey  <>  -  1  do 


1   then  n  :  =  0 


a 

m] 

a 

n] 

a 

.n] 

a 

n] 

a 

.n] 

a 

:n] 

a 

:n] 

a 

.n] 

a 

n] 

a 

n] 

a 

n] 

a 

n] 

a 

n] 

a 

n] 

a 

n] 

link  : =  n; 

hashkey  : =  n; 

inkey  :  =  b.  inkey; 

i  :  =  b.  i; 

j  :=  b.  j; 

modelno  :=  b.  modelno; 

tripletno  :=  b.  tripletno; 

keyl  :  =  b.  keyl; 

key2  :  =  b.  key2; 


basexl 
baseyl 
basex2 
basey2 
basex3 
baseyS 


=  b.  basexl; 
=  b.  baseyl; 
=  b.  basex2; 
=  b.  basey2; 
=  b.  basexS; 
=  b.  basey3; 


end; 
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procedure  initialize; 
var 

il  :  integer; 
begin 

for  il  : =  0  to  table_size 
begin 

a[  il]  .  hashkey  :  =  -  1; 
a[il]  .  link  :=  -  1; 
c[il]  :=  0; 
end; 
end; 


1  do 


procedur 

e   insert 

^var  m,n  : integer) 

begin 

if   (a[m] 

•hashkey  =   -    1)      then 

begin 

a[m] 

. hashkey   :  =m; 

a[m] 

. inkey   :  =  b. inkey; 

a[m] 

.  i   :  =  b.  i; 

a[m] 

•  j    :=  b.  j; 

a[m] 

.  modelno   :=  b.modelno; 

a[m] 

.  tripletno   :=  b.  tripletno; 

a[m] 

.  keyl   :  =  b.  keyl; 

a[m] 

.  key2   :=  b.  key2; 

a[m] 

. basexl 

=  b.  basexl; 

a[m] 

. baseyl 

=  b.  baseyl; 

a[m] 

. basex2 

=  b.  basex2; 

a[m] 

. basey2 

=  b.  basey2; 

a[m] 

. basex3 

=  b.  basex3; 

a[m] 

. baseyS 

=  b.  baseyS; 

c[n] 

:=   1; 

end; 

end; 

begin  {'''   main  *) 

open  ( input ,' inkey. dat' , history  :=  old); 
reset( input); 

open  (output ,' hash_table.  dat ', history  :=  new); 
rewrite( output); 
readln( input , tab le_size , prim); 
writeln( output , table_size ,prim) ; 
initialize; 
il  :=0;jl  :=  -  1; 
while  not  eof( input)  do 
begin 

with  b  do 
begin 

readln( input , inkey, i, j ,modelno, tripletno,keyl ,key2 , 

basexl , baseyl ,basex2,basey2,basex3,basey3); 
il  :=  inkey  rem  prim; 
end; 

jl  :=  ji  +  1; 

insert(il,  jl); 
end; 
close( input); 
open  ( input ,' inkey. dat ', history  :=  old); 
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reset ( input); 
12  :=  0;  j2  :  =-  1;  k2  :=  0; 
readln(  input , table_si2e,prim); 
while  not  eof( input)  do 
begin 

with  b  do 
begin 

readln( input , inkey , i, j , mode lno,tripletno, key 1 ,key2, 

basexl ,baseyl ,basex2,basey2,basex3,basey3); 
i2  : =  inkey  rem  prim; 
end; 
j2  :=  j2  +  1; 
if  c[  j2]  =  0  then 
collision( i2 ,k2); 
end; 
close( input); 
print; 

close(output); 
end. 

Vf'jV'sV'sV'jV'jV'jViV'jVVr'jV^ViV'jV'jV'jV-iV'jV'sV^^-sV'jViV^Sr'jViV  RECOGNITION  *'V^ViV'5V'5V'5V:^'5V'5ViViV'5V'5V')ViViViV'!V'>V'5V'>ViV'jV'5V'>V'A''jV'5ViV'>V'>V':ViV 
nV'jViViVVnViViV'sViViV'jV'jV-.V'iV'sVVnV'sViV-V-jV'sV'jV'jV  ( On~  line  Step)  iViViV'jVr^iV'jViViViV'jV'jViV'jViV'jV'jV'jVVfjViV'jVT'c'sV'jV'j'nViVVcV-'sV'jV 

program  test_gen( output); 

(*  This  module  generates  the  interesting  points  of  test  objects  *) 

{*   o/p  :  test_interesting_point  data  file  *) 

type 

ary  =  array  [1..  2,1..  50]  of  integer; 
var 

i, j ,modelno, interestingno  :  integer; 

x,y  :  ary; 
begin 

open(output, ' test_interesting_point.  dat' , history  :=  new); 

rewrite (output); 
('■'•  test  object  -') 


modelno 

=  1;  interestingno   :=   10; 

x[l,l] 

=  50;    x[l,2] 

=  40;    x[l,3] 

:=   30; 

x[l,4] 

=   10;    x[l,5] 

=    10; 

x[l,6] 

=  20;    x[l,7] 

=   30;    x[  1,8] 

:=   30;    x[l,9] 

:=  40; 

x[l,10] 

:=  40; 

y[i,i] 

=   10;    y[l,2] 

=  0;    y[l,3]    : 

=    10; 

y[i,4] 

=   10;    y[l,5] 

=  40; 

y[i,6] 

=  40;    y[l,7] 

=   50;    y[l,8] 

••=   30;    y[l,9] 

:=   30; 

y[i,io] 

:=   20; 

writeln(output , modelno, interestingno); 
for  i  : =  1  to  interestingno  do 
writeln(  interesting, x[  l,i]  ,y[  1 ,  i]  ); 
close(output); 
end. 

program  test_af f ine_calculation( input ,output ) ; 

("  This  module  rules  out  the  undesirable  triplets  and  finds  all  the 

affine  coefficient  pair  of  test  objects  *) 
("  i/p  :  test_interesting_point  data  file 
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o/p  :  test_af fine_coef ficient  data  file  *) 
const 

total  =  9999; 

tarea  =  533.  0; 
type 

ary  =  array  [  1.  .  total]  of  integer; 

aryl  =  array  [1.  .2,1..2]  of  real; 


ary2  =  array  [  1. 
ary3  =  array  [  1. 
ary4  =  array  [  1. 
var 

count ,i,k, index 


3]  of  integer; 
2,1.  .  1]  of  real; 
2, 1.  .  2]  of  integer; 


integer; 


modelno, inter estingno,table_size 
x,y,rest_basex,rest_basey  :  ary; 
inverse_matrix  :  aryl; 
basex,basey,corax, corny  :  ary2; 
diff, coord  :  ary3; 
base_niatrix  :  ary4; 


integer; 


procedure   test_raatrix_mult( inverse_matrix   :    aryl; 

var  diff, coord  :    ary3); 


const 

k  =  2; 

1  =  2; 

m  =  1; 

var 

i,  j.n 

:  integer; 

begin 

for  i 

:=  1  to  1 

for   j    : =   1   to  m  do 
cord[  i, j]    :=  0; 
for    i    : =    1   to    1   do 
for  j    : =   1   to  m  do 
for  n   : =   1   to   1   do 

coord[i,j]    :=  coord[i,j]    +   inverse_raatrix[  i,n]    * 
diff[n,j]; 
end; 


procedure  test_inverse(base_matrix  :  ary4; 

var  inverse_matrix 
var 

det  :  real; 
begin 
for  i 
det 


aryl); 


end; 


=   1   to  2   do 
=  (base_matrix[  1, 1] 
(base_matrix[  1,2] 
if   (det   <>   0.  0)    then 
begin 

inverse_matrix[  1 , 1] 
inverse_matrix[  1,2] 
inverse_matrix[  2 , 1] 
inverse_matrix[  2 , 2] 
end; 


*  base_matrix[  2,2]  ) 
"   base_matrix[  2, 1]  ); 


=  base_matrix[  2,2] /det; 
=  base_niatrix[  1,2]    -    (-1)    /det; 
=  base_matrix[  2,1]    ''^   (-1)    /det; 
=  base_raatrix[  1 , 1]    /det; 
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procedure  test_calculate_coord(basex,basey  :  ary2); 
var 

i,j,il,i2  :  integer; 
begin 

for  i  : =  1  to  2  do 
begin 

base_matrix[  1 ,  i]    :=  basex[  i]    -   basex[  i+1]  ; 
base_matrix[  2,  i]    :=  basey[  i]    -   basey[  i+1]  ; 
end; 
test_inverse(base_matrix, inverse_matrix); 
i2    :=   1; 

for   i   : =   1   to   interestingno  do 
begin 

if   ((basex[l]    <>  x[  i]  )   or   (basey[  1]    <>  y[  i]  ) )    and 
((basex[2]    <>  x[  i]  )   or   (basey[2]    <>  y[i]))    and 
((basex[3]    <>  x[  i]  )    or   (basey[3]    <>  y[i]))    then 
begin 

rest_basex[  i2]    :=  x[  i]  ; 
rest_basey[  i2]    :  =  y[  i]  ; 
i2   :=   i2  +1; 
end; 
end; 

for   i   : =   1   to   interestingno[ 3  do 
begin 

diff[l,l]    :=  rest_basex[  i]    -   basex[  3]  ; 

diff[2,l]    :=  rest_basey[  i]     -   basey[  3]  ; 

test_raatrix_mult( inverse_matrix,diff, coord); 

count   : =  count  +1; 

wr it e( coordinate, mode Ino, count ,coord[ 1,1] ,coord[ 2,1] ); 

for  il  :=  1  to  3  do 

u"rite(output  ,basex[  il]  ,basey[  il]  ); 
wr iteln( output ) ; 
end; 
end; 


procedure   test_perm(basex,basey   :    ary2; 

k   :     integer); 
var 

i,tx,ty  :  integer; 
begin 

if  k  =  3  then 

test_calculate_coord(basex,basey) 
else 

for  i  : =  k  to  3  do 
begin 

tx   :  =  basex[  i]  ; 
ty  :  =  baseyi  i]  ; 
basex[  i]    :=  basex[k]; 
basey[  i]    :=  basey[k]; 
basex[  k]    :  =  tx; 
basey[  k]    :  =  ty; 
test_perm(basex,basey,k+l); 
end; 
end; 
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procedure  area_test(comx, corny  :  ary2); 
var 

s ,a,b,c,sarea,area  :    real; 
begin 

a   :  =  sqr(  corax[  2]  [  corax[  1]  )+sqr( comy[  2]  ]  corny [  1]  ) ; 

b   :  =  sqr(comx[  3]  [  comx[  2]  )+sqr(comy[  3]  ]  comy[  2]  ); 

c   :=  sqr(comx[  1]  [  comx[  3]  )+sqr(comy[  1]  ]  comy[  3]  ); 

a   :=  sqrt(a); 

b   :=  sqrt(b); 

c   :=  sqrt(c); 

s    :=   (a  +  b  +  c)/2.0; 

sarea   :=  s''=-(s[  a)''Ks]  b)*(s[  c); 

sarea   :=  sqrt(sarea); 

area  :=  tarea/10.0; 

if  (sarea  >  area)  then 
test_perm( comx, corny, 1); 
end; 

procedure  comb(k, index  :  integer); 
var 

i  :  integer; 
begin 

if  index  >  3  then  area_test( comx, corny) 
else 

for  i  :  =  k  to  interestingno  do 
begin 

comx[  index]    :  =  x[  i]  ; 
comyi  index]    :  =  y[  i] ; 
comb( i+1 , index+1 ) ; 
'end; 
end; 

beginC'^  main  ''<■) 

open( input ,' test_interesting_point.  dat' , history  :=  old); 
reset( input); 

open(output, ' test_affine_coefficient. dat ', history  :=  new); 
r ewr it e( output ) ; 
table_size  :  =  0; 
while  not  eof( input)  do 
begin 

readln( input ,modelno, interestingno); 
writeln(output , interestingno); 
for  i  : =  1  to  interestingno  do 

readln(  input  ,x[  i]  ,y[  i]  ); 
count  : =0; 
comb( 1,1); 

table_size  :=  table_size  +  count; 
end; 

close( input); 
close(output); 
end. 

program  tes t_inkey ( input , output ) ; 

("  This  module  converts  every  bin  index  (i,  j)  to  an  inkey  and  generates 
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the  tally  data  file  *) 
(*  i/p  :  test_af f ine_coef f icient  data  file 

o/p  :  tally  data  file  ''0 
type 

inrec  =  record 

modelnojtripletno  :  integer; 
keyl,key2  :  real; 

basexl jbaseyl ,basex2,basey2,basex3,basey3  :  integer 
end; 
var 

b  :  inrec; 

inf ile,outf ile  :  text; 
dk,kl  ,k.2,  inkeyl  :  real; 
i , il , j , interestingno, inkey  :  integer; 
begin 

open  ( input , ' test_affine_coeff icient.  dat ' , history:  =old); 
reset( input); 

open  (output, ' tally. dat' , history: =new); 
rewrite( output ) ; 
il  :=  0; 

readln( input , interestingno); 
writeln( output , interestingno); 
dk  :=  2.0->arctan(20.  0)/90.  0; 
while  not  eof(infile)  do 
with  b  do 
begin 

read ln( inf ile ,modelno , triple tno,keyl ,key2, 

basexl ,baseyl ,basex2 ,basey2,basex3,basey3); 
kl  :=  arctan(keyl)/dk; 
k2  :=  arctan(key2)/dk; 
if  (kl  >=  0.  0)  then 
begin 

i  :=  trunc(kl)  +  46; 
if  (i  >  90)  then  i  :  =  90; 
end; 
if  (kl  <  0.  0)  then 
begin 

i  : =  trunc(kl)  +  45; 
if  (i  <  1)  then  i  :=  1; 
end; 
if  (k2  >=  0.  0)  then 
begin 

j  :=  trunc(k2)  +  46; 
if  (j  >  90)  then  j  :=  90; 
end; 
if  (k2  <  0.  0)  then 
begin 

j  :=  trunc(k2)  +  45; 
if  (j  <  1)  then  j  :=  1; 
end; 
inkeyl  :=  (0.839'H  +  0.  364''^j  )'n00; 
inkey  :=  trunc( inkeyl); 
writeln(output, inkey, i, j , key 1, key 2, 

basexl,baseyl ,basex2,basey2,basex3,basey3); 
il  :=  il+1; 
end; 
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close( inf ile); 
close(outf ile); 
end. 

program  af f ine_matching( input ,candf ile, output); 

('■'   This  module  applies  partial  voting  technique  to  select  all  the 

entries  which  satisfy  the  top[six]max  criteria  *) 
(*   i/p  :  hash_table  and  tally  data  files 

o/p  :  vote  data  file  *) 
const 

database_modelno  =  2; 
type 

candrec  =  record 

inkey,i,j  :  integer; 

keyl,key2  :  real; 

basexl jbaseyl ,basex2,basey2,basex3,basey3  :  integer; 

end; 
modelrec  =  record 

hashkey, inkey, i, j ,modelno, tripletno, link  :  integer; 

keyl,key2  :  real; 

basexl ,baseyl,basex2,basey2,basex3 jbasey3,a  :  integer; 

end; 
collected_modelrec  =  record 

hashkey , inkey , i,j ,modelno, tripletno, link  :  integer; 

keyl,key2  :  real; 

basexl, baseyl,basex2,basey2,basex3,basey3, a  :  integer; 

votel  :  real; 

end; 
var 

temporary_model,temp  :  array[ 0. . 9999]  of  modelrec; 

model  :  array  [ 0. . 23000]  of  modelrec; 

collected_raodel  :  array[ 1. . 9999]  of  collected_modelrec; 

tmodel,smodel ,gmodel ,pmodel  :  array[ 1. . 1000]  of  collected_modelrec; 

cand  :  array[ 0. . 19999]  of  candrec; 

candl,cand2  :  array  [  1. . 9999]  of  candrec; 

tcand,scand,gcand,pcand  :  array[ 1. . 1000]  of  candrec; 

il, jl,k, kl,m, index, count ,n, prim, f ,h,g,hkey, ix, iy , jx, jy ,cl ,c2  :  integer; 

max 11 ,maxl 2, max 13, max 14, max 15 , max 16 

max21 ,max22,max23,max24,max25,max26 

thl,th2  :  real; 

table_s  ize , interest ingno , test_interest ingno_3 , 

bl,b2,sl,s2 ,w,tl,t2  :  integer; 

candfile  :  text; 

vote  :  array[ 0.  . database_modelno,0.  . 27999]  of  real; 

outmodelno,outinterestingno  :  array  [ 1.  .  database_modelno]  of  integer; 

procedure  initializel; 
var 

i,j  :  integer; 
begin 

for   i   : =  0   to  database_modelno  do 
for   j    : =  0   to  table_size  do 
vote[i,j]    :=  0.0; 
end; 
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procedure  print(i6,k  : integer); 
begin 

with  graodel[  i6]  do 
begin 

writeln( output ,hashkey,inkey,raodelno:  2,tripletno:  4, 

keyl ,key2,basexl: 4,baseyl: 4,basex2: 4,basey2:  4, 
basex3: 4,basey3:  4,votel ,k); 
gcand[  i6]  .  keyl  :  =  keyl; 
gcand[  i6]  .  key2  :  =  key2; 
end; 
with  gcand[  i6]  do 

writeln(output , '  ':10,inkey,'  ' : 6,keyl ,key2 ,basexl: 4, 
baseyl: 4,basex2: 4,basey2: 4,basex3: 4,basey3: 4); 
end; 

procedure  delet(h  :  integer); 
var 

k,i,j, jl,q,hl,l,w  :  integer; 
begin 

k  :=  l;hl  :=  0;w  :=  0; 
while  (k  <=  h)  do 
begin 

if   (smodel[k].a  =  0)    then 
begin 
j    :=   0; 

q   :=   smodel[  k]  .  inkey; 
for   i    :  =    1    to   h   do 
begin 

if   (srtiodel[  i]  .  inkey  =  q)    and   (j   =  0)    then 
begin 

j  :=  j  +  1; 
hi    :=  hi  +   1; 
gmodel[hl]     :=   smodel[  i]  ; 
gcand[hl]    :=  scand[  i]  ; 
end 
else 

if   (smodel[ i] . inkey  =  q)    and   (j    <>   0)    then 
smodeli  i]  .  a   :  =   1; 
end; 
end; 

k  :=  k  +1; 
end; 
if   (graodel[  1]  .  tnodelno  =   1)    and   (hi   >=  tl)    then 
begin 

for    1   :=   1   to  hi   do 
print( l,hl); 
end; 
if   (gmodel[ 1] . modelno  =  2)    and   (hi   >=  t2)    then 
begin 

for    1   :=   1   to  hi   do 
print( 1 ,hl); 
end; 
end; 
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procedure  selectl(pl  :  integer); 
var 

k,q,h,i  :  integer; 
begin 
k  :=  1; 

while(k  <=  pi)  and  (si  =  0)  do 
begin 

if   (tmodel[k].a  =  0)    then 
begin 
h   :=  0; 

q   :=  tmodel[  k]  .  tripletno; 
for   i   : =   1   to  pi   do 
begin 

if   (tmodel[ i]  .  tripletno  =  q)    then 
begin 

h   :=  h  +   1; 

smodel[h]    :=  tmodel[  i]  ; 
scand[h]    :=  tcand[  ij ; 
tmodel[  i]  .  a  :  =   1; 
end; 
end; 
if   (h  >=  tl)   then 
delet(h); 
end; 
k  :=  k  +   1; 
end; 
end; 

procedure  select2(pl    :    integer); 
var 

k,q,h,i   :     integer; 
begin 
k   :=   1; 

while(k  <=  pi)    and   (s2  =  0)    do 
begin 

if   (tmodel[k].a  =  0)    then 
begin 
h   :=  0; 

q  :=  tmodel[  k]  .  tripletno; 
for   i   : =   1   to  pi   do 
begin 

if   (tmodel[ i] . tripletno  =  q)    then 
begin 

h   :=  h  +   1; 

smodel[h]    :=  tmodel[  i]  ; 
scand[h]    :=  tcand[  ij ; 
tmodel[  i]  .  a   ;  =   1; 
end; 
end; 
if   (h  >=  t2)    then 
delet(h); 
end; 
k  :=  k  +   1; 
end; 
end; 
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procedure  all_maximun_selected(n  :  integer); 
var 

i5,pl  :  integer; 
begin 

if  (si  =0)  then 
begin 
pi  :=  0; 
for  i5  : =  1  to  n  do 

with  collected_model[  i5]  do 
if  (modelno  =  1)  and 

( (cand2[ i5] .  inkey  <>  0)  and  (votel  =  maxll))  then 
begin 

pi  :=  pi  +  1; 

tmodel[pl]    :=  collected_model[  i5]  ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (si   =0)    then 
begin 

pi    :=   0; 

for   i5    : =   1   to  n  do 

with  collected_model[  i5]  do 
if  (modelno  =1)  and 

((cand2[ i5] . inkey  <>  0)  and  (votel  =  maxl2))  then 
begin 

pi  :=  pi  +  1; 

tmodel[pl]    :=  collected_model[  i5]  ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (si  =0)    then 
begin 

pi    :=   0; 

for    i5    : =   1   to  n  do 

with  collected_model[  i5]  do 
if  (modelno  =  1)  and 

( (cand2[ i5] . inkey  <>  0)  and  (votel  =  maxl3))  then 
begin 

pi  :=  pi  +  1; 

traodel[pl]    :=  collected_model[  i5]  ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (si   =0)    then 
begin 
pi   :=  0; 
for   i5    :  =   1   to  n  do 

with  collected_model[  i5]    do 
if   (modelno  =   1)    and 

((cand2[  i5]  .  inkey   <>   0)    and   (votel  =  maxlA))    then 
begin 

pi    :=  pi   +   1; 

tmodel[pl]     :=   collected_model[  i5]  ; 
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tcand[pl]  :=  cand2[  15]  ; 
end; 
selectl(pl); 
end; 
if  (si  =0)  then 
begin 
pi  :=  0; 
for  i5  : =  1  to  n  do 

with  collected_model[ i5]  do 
if  (modelno  =  1)  and 

((cand2[ i5]  .  inkey  <>  0)  and  (votel  =  maxlS))  then 
begin 

pi  :=  pi  +  1; 

tmodel[pl]    :=  collected_model[  i5] ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (si  =0)    then 
begin 
pi   :=  0; 
for   i5   : =   1  to  n  do 

with  collected_model[ i5]    do 
if   (modelno  =   1)    and 

((cand2[ i5] . inkey  <>   0)    and   (votel  =  maxl6))    then 
begin 

pi   :=  pi  +   1; 

tmodel[pl]    :=  collected_model[  i5]  ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (s2  =0)    then 
begin 

pi    :=  0; 

for   i5    : =   1   to  n  do 

with  collected_raodel[ i5]    do 
if   (modelno  =2)    and 

((cand2[ i5] . inkey  <>   0)    and   (votel  =  max21))    then 
begin 

pi   :=  pi  +   1; 

tmodel[pl]    :=  collected_model[  i5]  ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (s2  =0)    then 
begin 

pi   :=  0; 

for   i5    : =   1   to  n  do 

with  collected_model[ i5]  do 
if  (modelno  =  2)  and 

((cand2[ i5] . inkey  <>  0)  and  (votel  =  max22))  then 
begin 

pi  :=  pi  +  1; 

tmodel[pl]    :=  collected_model[  i5]  ; 
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tcand[pl]  :=  cand2[  15]  ; 
end; 
selectl(pl); 
end; 
if  (s2  =0)  then 
begin 

pi  :=  0; 

for  i5  : =  1  to  n  do 

with  collected_model[ i5]  do 
if  (modelno  =  2)  and 

((cand2[ i5] . inkey  <>  0)  and  (votel  =  max23))  then 
begin 

pi  :=  pi  +  1; 

tmodel[pl]    :=  collected_model[  i5]  ; 
tcand[pl]    :=  cand2[  i5]  ; 
end; 
selectl(pl); 
end; 
if   (s2  =0)    then 
begin 

pi    :=   0; 

for   i5   :  =   1   to  n  do 

with  collected_model[ i5]    do 
if   (modelno  =  2)    and 

((cand2[  i5]  .  ir.key  <>   0)    and   (votel  =  max24))    then 
begin 

pi    :=  pi   +    1; 

tmodel[pl]    :=  collected_model[  15]  ; 
tcand[pl]    :=  cand2[  15]  ; 
end; 
selectl(pl); 
end; 
if   (s2  =0)    then 
begin 

pi    :=   0; 

for   15    : =   1   to  n  do 

with  collected_model[ 15]  do 
if  (modelno  =  2)  and 

((cand2[ 15] . inkey  <>  0)  and  (votel  =  max25))  then 
begin 

pi  :=  pi  +  1; 

tmodel[pl]    :=  collected_model[  15]  ; 
tcand[pl]    :=  cand2[  15]  ; 
end; 
selectl(pl); 
end; 
if   (s2   =0)    then 
begin 
pl   :=  0; 
for   15   : =   1   to  n  do 

with  collected_model[ 15]    do 
if   (modelno  =  2)    and 

((cand2[ 15] . inkey  <>   0)    and  (votel  =  max26))    then 
begin 

pl    :=  pl   +    1; 

tmodel[pl]    :=  collected_model[  15]  ; 
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tcand[pl]    :=cand2[i5]; 

end; 

selectl(pl); 

end; 

end; 

procedure  verify( jl,k,m  :    integer; var  n  :    integer); 

var 

i4,q  :    integer; 

begin 

for   i4   : =   1   to  m  do 

with  temporary_model[ i4]    do 

if   (modelno  =  temporary_model[ k] . modelno)    and 

(tripletno  =  temporary_model[ k] . tripletno)    then 

begin 

n   :  =  n  +   1; 

collected_model[  n]  .  hashkey   :=  hashkey;                             >;.; 

collected_model[ n] . inkey   :=   inkey; 

col lected_model[ n] . modelno   :=  modelno; 

col lected_raodel[ n] . tripletno   :=  tripletno; 

collected_model[  n]  .  keyl   :=  keyl; 

collected_model[  n]  .  key2   :=  key2; 

collected_model[ n] . basexl 

=  basexl; 

collected_model[ n] . baseyl 

=  baseyl; 

collected_model[ n] . basex2 

=  basex2; 

collected_model[ n] . basey2 

=  basey2; 

collected_raodel[ n]  .  basex3 

=  basex3; 

collected_model[ n] .baseyS 

=  basey3; 

collected_model[ n]  .  votel   :=  vote[ modelno, tripletno]  ; 

for  q   :=  (jl    -   test_interestingno_3)    to   j 1    -    1   do 

if   (abs(cand[  q]  .  keyl    -   keyl)    <   0.04)    and 

(abs(cand[q]  .key2    -   key2)    <  0.04)    then 

cand2[  n]    :  =  candj  q]  ; 

end; 


end; 


procedure  top_six_raaximun(m  :  integer; var  k  :  integer); 
var 

i3  :  integer; 
max  :  real; 
begin 

max  :  =0.  0; 

for  i3  : =  1  to  m  do 

with  temporary_model[ i3]  do 

if  (vote[ modelno, tripletno]  >  max)  then 
begin 
k  :=i3; 

max  :=  vote[ modelno, tripletno] ; 
if  (modelno  =  1)  then 
begin 
if  (max  >  maxll)  then 

maxll  : =  max 
else 
if  (max  <>  maxll)  and  (max  >  maxl2)  then 

maxl2  : =  max 
else 
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if  ((max  <>  maxll)  and  (max  <>  maxl2))  and  (max  >  maxl3)  then 

max 13  :  =  max 
else 

if  ((max  <>  maxll)  and  (max  <>  maxl2))  and  ((max  <>  maxl3)  and 
(max  >  maxl4))  then 


maxl4  :  =  max 


else 

if  (((max  <>  maxll)  and  (max  <>  maxl2))  and  ((max  <>  maxlS)  and 
(max  <>  maxl4)))  and  (max  >  maxl5)  then 

maxl5  : =  max 
else 

if  ((max  <>  maxll)  and  (max  <>  maxl2))  and  ((max  <>  maxlS)  and 
(max  <>  maxl4))  and  ((max  <>  maxl5)  and  (max  >  maxl6))  then 

maxl6  :  =  max; 
end; 

if  (modelno  =  2)  then 
begin 
if  (max  >  max21)  then 

max21  :  =  max 
else 
if  (max  <>  max21)  and  (max  >  max22)  then 

max22  :  =  max 
else 
if  ((max  <>  max21)  and  (max  <>  max22))  and  (max  >  max23)  then 

max23  :  =  max 
else 

if  ((max  <>  max21)  and  (max  <>  max22))  and  ((max  <>  max23)  and 
(max  >  max24))  then 

max24  : =  max 
else 
if  (((max 


se 

'   (((max  <>  max21)  and  (max  <>  max22))  and  ((max  <>  max23)  and 

(max  <>  max24)))  and  (max  >  raax25)  then 

max25  : =  max 

se 

((max  <>  max21)  and  (max  <>  max22))  and  ((max  <>  max23)  and 

(max  <>  max24))  and  ((max  <>  max25)  and  (max  >  max26))  then 

max26  : =  max; 
A. 


end; 


procedure  search(hkey , i, j , f  :  integer;  var  m  :  integer); 

var 


i2    :     integer; 
begin 

i2   :  =  hkey; 
while   (i2   <>   [ 1)      d 
begin 


if   (i  =  model[  i2]  .  i)    and 
(j   =  model[i2],j)    then 


begin 

m   :  =  m  +   1; 


m   :  =  m  +   1; 

temporary_model[  m]    :=  model[  i2]  ; 

with  temporary_model[ m]    do 


begin 

if   f  =   1   then 
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vote[  tnodelno,  tripletno]    :=  vote[rnodelno,tripletno]    +   1.0; 
if   f  =  2   then 

vote[  modelno,  tripletno]    :=  vote[  modelno,  tripletno]    +  0.5; 
if   f  =  3   then 

vote[  modelno,  tripletno]    :=  vote[  modelno,  tripletno]    +  0.25; 
end; 
end; 
i2   :=  raodel[  i2]  .  link; 
end; 
end; 

procedure  partial(prim, i, j ,f  :  integer;  var  m  :  integer); 
var 

inkey,hkey  :  integer; 

inkeyl  :  real; 
begin 

inkeyl  :=  (0.  839*i  +  0.  364''^j  )*100; 

inkey  :=  trunc( inkeyl); 

hkey  : =   inkey  rem  prim; 

search(hkey, i, j , f ,m); 
end; 

begin('^  main  *) 

open  ( input , 'hash_table.  dat' , history  :=  old); 
reset( input); 

open  (candfile, ' tally. dat ', history  :=  old); 
reset(candf ile); 

open  (ref ,' ref. dat' , history  :=  old); 
reset(ref ); 

open  (output , 'vote. dat ', history  :=  new); 
rewr  it e( output ) ; 
readln( input , tab le_size, prim); 
readln( candfile, interestingno); 
readln(ref ,thl,th2); 

test_interestingno_3  :=  interestingno  -  3; 
initializel; 
tl  :=  trunc(thl); 
t2  : =  trunc(th2); 

il  :=0;jl  :=  0;kl  :=  1;  cl  :=  1;  c2  :=  1; 
while  not  eof( input)  do 
begin 

with  model[  il]  do 

readln( input ,hashkey, inkey, i, j , modelno, tripletno, key l,key2, 

basexljbaseyl ,basex2,basey2,basex3,basey3 , link); 
il  :=  il  +  1; 
end; 
m  :=  0;k  :=l;n  :=  0;  f  :=  1;  g  :=  2;h  :=  3; 
(*  partial  voting  -) 

while  not  eof( candfile)  do 
begin 

with  cand[  j  1]  do 

begin 

readln( candfile, inkey, i, j ,keyl ,key2 ,basexl ,baseyl, 

basex2 ,basey2 ,basex3 ,basey3) ; 
hkey  :=  inkey  rem  prim; 
search(hkey , i, j , f ,m); 


IX 

iy 

jy 


=  i  -  1 

=  i  +  1 

=  J  -  1 

=  J  +  1 


if  ((i  >  0)  and  (i  <  91))  and  ((jx  >  0)  and  (jx  <  91))  then 

part ial( prim, i,jx,g,m); 
if  ((i  >  0)  and  (i  <  91))  and  ((jy  >  0)  and  (jy  <  91))  then 

part ial( prim, i,jy,g,m); 
if  ((ix  >  0)  and  (ix  <  91))  and  ((j  >  0)  and  (j  <  91))  then 

partial (prim, ix, j ,g,ra); 
if  ((iy  >  0)  and  ( iy  <  91))  and  ((j  >  0)  and  (j  <  91))  then 

partial(prim,iy, j ,g,m); 
if  ((iy  >  0)  and  ( iy  <  91))  and  ((jx  >  0)  and  (jx  <  91))  then 

partial (prim, iy , jx,h,m); 
if  ((iy  >  0)  and  ( iy  <  91))  and  ((jy  >  0)  and  (jy  <  91))  then 

partial (prim, iy , jy ,h,m); 
if  ((ix  >  0)  and  ( ix  <  91))  and  ((jy  >  0)  and  (jy  <  91))  then 

partial(prim,ix, jy,h,m); 
if  ((ix  >  0)  and  ( ix  <  91))  and  ((jx  >  0)  and  (jx  <  91))  then 

partial(prim,ix, jx,h,m); 
end; 

jl  :=  ji  +  1; 

count  :=  jl  mod  test_interestingno_3; 
if  count  =  0  then 
begin 

top_s  ix_raaximun( m , k) ; 

verify( jl,k,m,n); 

m  :=  0; 

initializel; 
end; 
end; 

all_maximun_selected(n); 
close( input); 
close ( candf ile); 
close( ref ); 
close(output); 
end. 


J^J^mJ^m?^.*.J^J^J,^*^,'Mj 


>t.  ^«  JU  .•«  .U  .* — t — t — *«  .U  .V  -J'  -Jf  ^*'  -*c  >V  -'r  ^« 


program  reconstruct( input , vote ,ploting) ; 

(*  This  module  does  the  inverse  affine  transformation  to  calculate 

the  interesting  point  sets  of  the  qualified  candidate  triplets  *) 
("  i/p  :  model_interesting_point  and  vote  data  files 

o/p  :  ploting  data  file  ">'') 
const 

totalmodelno  =  2; 
type 

aryl  =  array  [  1.  .  10]  of  integer; 

ary2  =  array  [  1. . 999]  of  integer; 

ary3  =  array  [  1.  .  99]  of  real; 

ary4  =  array  [  1.  .  10, 1.  .  99]  of  integer; 

ary5  =  array  [  1.  .  3]  of  integer; 

ary6  =  array  [1..2,1..2]  of  integer; 

ary7  =  array  [1..2,1..2]  of  real; 
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ary8  =  array  [1..2,1..1]  of  real; 
var 

orimodelno  :  aryl; 

select_basex,select_basey ,test_basex,test_basey ,rest_basex, 

rest_basey  :  ary2; 

hashkey, inkey,modelno,tripletno  :  integer; 

recogmodelno, recoginterestingjVOt ,a  :  integer; 

collected_keyl,collected_key2,votl  :  real; 

test_recogx, test_recogy, order ed_test_inter_coordx, 

ordered_tes t_inter_coordy , 

ordered_test_basex,ordered_test_basey  :  ary3; 

x,y jOriinterestno  :  ary4; 

oritXjOrity  :  ary5; 

base_matrix  :  ary6; 

inverse_matrix  :  ary7; 

diff, coord  :  ary8; 

deletemodelno  :   array  [ 0. . totalmodelno]  of  integer; 

vote,ploting  :  text; 

korder,jr  :  integer; 

i  :  integer; 


procedure  matrix_mult(  inverse_niatrix 

var  diff, coord 


const 

k  = 

1  = 

ra  = 
var 

i,il,n   : 
begin 

for   i   : = 
for   il 


integer; 


ary7; 
ary8); 


end; 


1   to   1   do 
: =   1   to  m  do 
coord[  i,  il]    :  =  0; 
for   i   : =   1   to   1   do 
for   il   : =   1   to  m  do 
for  n   : =   1   to    1   do 

coord[i,il]    :=  coord[i,il]    +  inverse_matrix[  i,n] 
diff[n,il]  ; 


procedure   inverse(base_matrix  :    ary6; 
var 

inverse_matrix  :    ary7); 
var 

det   :    real; 
begin 

det   :=   (base_raatrix[  1 , 1]    *  base_matrix[  2,2]  ) 
(base_matrix[  1,2]    -   base_raatrix[  2, 1]  ); 
if   (det   <>   0.  0)    then 
begin 

inverse_raatrix[ 1 , 1] 
inverse_matrix[  1,2] 
inverse_matrix[ 2 , 1] 
inverse_matrix[  2 , 2] 
end; 
end; 


=  base_inatrix[  2,2] /det; 
=  base_matrix[  1,2]    -    (-1)    /det; 
=  base_matrix[ 2,1]    *   (-1)    /det; 
=  base_matrix[  1, 1]    /det; 
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procedure  calculate_coord( recogmodelno  :  integer; 

cbaseXjCbasey  :  ary5); 
var 

i,m,il,i2,i3  :  integer; 
begin 

for  i  : =  1  to  2  do 
begin 

base_matrix[  1 ,  i]    :=  cbasex[  i]    -   cbasex[  i+1]  ; 
base_matrix[  2,  i]    :=  cbasey[  i]    -   cbasey[  i+1]  ; 
end; 
inverse(base_matrix, inverse_matrix); 
i2   :=   1; 

for   i   :  =   1   to  oriinterestno[ orimodelno[ recogmodelno]  , 

recogmodelno]    do 
begin 

if   ((cbasex[l]    <>  x[  recogmodelno,  i]  ) 

or   (cbasey[l]    <>  y[  recogmodelno,  i]  ) )    and 
((cbasex[2]     <>   x[  recogmodelno,  i]  ) 
or   (cbasey[2]    <>  y[  recogmodelno,  i]  ) )    and 
((cbasex[3]    <>  x[  recogmodelno,  i]  ) 
or   (cbasey[3]    <>  y[  recogmodelno,  i]  ) )    then 
begin 

rest_basex[  i]    :=  x[  recogmodelno,  i]  ; 
rest_basey[  i]     :=  y[  recogmodelno,  i]  ; 
diff[l,l]    :=   rest_basex[  i]    -   cbasex[  3]  ; 
diff[2,l]    :=  rest_basey[  i]     -   cbasey[  3]  ; 
matrix_mult( inverse_matrix,diff, coord); 
ordered_test_inter_coordx[  i]  :  =coord[  1,1]* 
(ordered_test_basex[ 1] [ ordered_test_basex] 2[ )+ 
coord[  2, 1]  "(ordered_test_basex[  2]     - 
ordered_test_basex[ 3] )+ 
ordered_test_basex[ 3] ; 
ordered_test_inter_coordy[  i]  :  =coord[  1 , 1] ''' 
(ordered_test_basey[ 1] [ ordered_test_basey] 2[ )+ 
coord[  2, 1]  ''Kordered_test_basey[  2]     - 
ordered_test_basey[ 3] )+ 
ordered_test_basey[ 3] ; 
end; 
end; 
for   i   : =   1   to  oriinterestno[ orimodelno] recogmodelno[  , 

recogmodelno]    do 
writeln(ploting,ordered_test_inter_coordx[ i]  , 
ordered_test_inter_coordy[ i] ); 
end; 

rocedure   colinear(var   comx,comy   :    ary5; 

var  tl,t2   :    real); 
var 

colinearxl ,colinearx2,colinearyl,colineary2  :  integer; 
begin 

colinearxl  :=  comx[  2]  -  comx[  1] 

colinearx2  :=  comx[  3]  -  comx[  2] 

colinearyl  :=  comy[  2]  -  comy[  1] 

colineary2  :=  comy[  3]  -  comy[  2] 

if  (colinearxl  <>  0)  then 
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tl  :=  arctan(colinearyl  /  colinearxl) 
else  tl  :=  1.5707; 
if  (colinearx2  <>  0)  then 

t2  :=  arctan(colineary2  /  colinearx2) 
else  t2  :=  1.5707; 
end; 

procedure  pretest(i,j  :  integer; 

var  tl,t2  :  real); 
var 

count  :  integer; 
begin 

count  : =  1; 

while   ((test_recogx[ j] <>0)   or   (test_recogy[ j] <>0) )    and 
(count   <  4)    do 
begin 

oritx[  count]  :  =x[  i,  j]  ; 
ority[  count]  :=y[  i,j]  ; 

ordered_test_inter_coordx[ j]    :=  test_recogx[ j]  ; 
ordered_test_inter_coordy[ j]    :=  test_recogy[ j]  ; 
ordered_test_basex[ count]    :=  test_recogx[ j] ; 
ordered_test_basey[ count]    :=  test_recogy[ j] ; 

j  :=  j  +  1; 

count  :=  count+1; 

end; 

colinear(oritx,ority ,tl,t2); 

end; 

procedure  mapping(bx,by  :  real; 

var  ordering  :  integer; 
i  :  integer); 
var 

j  :  integer; 
begin 

for  j  : =  1  to  oriinterestno[ oriraodelno[ i] , i]  do 
begin 

if  (abs(bx  -  x[i,j])  <  0.00001)  and 
(abs(by  -  y[i,j])  <  0.00001)  then 
ordering  :=  j; 
end; 
end; 

procedure  interest; 
var 

i,j  :  integer; 
begin 

open( input , 'model_interesting_point.  dat' , history  :=  old); 
reset( input); 

open(ploting, 'ploting. dat ', history  :=  new); 
rewrite(ploting); 
i:=l; 

while  not  eof( interesting)  do 
begin 

read( interesting, orimodelno[  i]  ); 

readln( interesting, oriinterestno[  orimodelno[  i]  , i]  ); 

for  j  :  =  1  to  oriinterestno[  orimodelno[  i]  ,i]  do 
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readln( interesting, x[ orimodelno[ i] ,j] , 

y[  orimodelno[  i]  ,  j]  ); 
i  :=  i+1; 
end; 
end; 

procedure   recognized; 
var 

i,il,i2,j,jl   :     integer; 
select_raodel_tempx,select_model_tempy ,tl ,t2   : real; 
begin 

open   (vote, 'vote,  dat' , history   :=  old); 

reset( vote); 

i   :=1; 

while   (not   eof(vote))   do 

begin 

readln(  vote,hashkey ,  inkey , mode Ino, trip letno, collect ed_keyj., 
collected_key2 , 

select_basex[  1]  ,select_basey[  1]  ,select_basex[  2]  , 
select_basey[ 2] ,select_basex[ 3] ,select_basey[ 3] ,votl,a); 
readln( vote , inkey , collected_keyl , collected_key2 , 
test_basex[  1]  ,test_basey[  1]  ,test_basex[  2]  , 
test_basey[  2]  ,test_basex[  3]  , test_basey[  3]  ); 
recograodelno   :=  modelno; 

if   (votl/(oriinterestno[  orimodelno[  recograodelno]  ,  recograodelno] -3)    >=  0.5)   tht 
begin 

for   J: =1    to   3   do 
begin 

mapping( select_basex[ j] ,select_basey[ j] ,jr, 

recograodelno); 
test_recogx[  jr]    :=  test_basex[  j]  ; 
test_recogy[  jr]    :=  test_basey[  j]  ; 
end; 
select_raodel_terapx   :=  collected_keyl"(select_basex[ 1] - 
select_basex[  2]  )+  collected_key2''"(select_basex[  2]  - 
select_basex[ 3] )+select_basex[ 3] ; 

select_model_tempy   :=  collected_keyl'''(select_basey[  1] - 
select_basey[ 2] )+  collected_key2"(select_basey[  2]  - 
select_basey[ 3] )+select_basey[ 3] ; 
mapping(select_raodel_terapx,select_model_tempy , jr , 
recograodelno); 

test_recogx[  jr]    :=  collected_keyl'''( test_basex[  1] - 
test_basex[  2]  )  + 

collected_key2"( test_basex[ 2] -test_basex[ 3] ) 
+test_basex[  3]  ; 

test_recogy[  jr]    :=  collected_keyl*(test_basey[  1] - 
test_basey[  2]  )  + 

collected_key2"( test_basey[ 2] -test_basey[ 3] ) 
+test_basey[ 3] ; 
for   jl   :  =   1   to   a[  1   do 
begin 

readln( vote , hashkey , inkey , mode Ino , trip letno , 
collected_keyl ,collected_key2 , 

select_basex[ 1] ,select_basey[ 1] ,select_basex[ 2] , 
select_basey[ 2] ,select_basex[ 3] ,select_basey[ 3] ); 
readln( vote , inkey , col lected_key 1 , col lected_key2 , 
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test_basex[  1]  ,test_basey[  1]  ,test_basex[  2]  , 
test_basey[  2]  ,test_basex[  3]  ,  test_basey[  3]  ); 

select_model_tempx  :=  collected_keyl"'^(select_basex[  1] 

select_basex[  2]  )+  collected_key2'''f(select_basex[  2]  - 

select_basex[ 3] )+select_basex[ 3] ; 

select_model_tempy   :=  collected_keyl''f(select_basey[  1] 

select_basey[  2]  )+  collected_key2'''''(select_basey[  2]  - 

select_basey[ 3] )+select_basey[ 3] ; 

mapp ing( s e 1 ec t_mode l_t empx , s e 1 ec t_mode l_t empy , j r , 
recogmodelno); 

test_recogx[ jr]    :=  collected_keyl*( test_basex[ 1] - 

test_basex[  2]  )+collected_key2''' 

(test_basex[  2]  -test_basex[  3]  )+test_basex]  3[ ; 

test_recogy[  jr]    :=  collected_keyl*( test_basey[  1] - 

test_basey[  2]  )+collected_key2''' 

(test_basey[  2]  -test_basey[  3]  )+test_basey]  3[ ; 

end; 

writeln(ploting, recogmodelno,oriinterestno[ 

orimodelno[ recogmodelno] , recogmodelno] ); 

il:=l;  tl:=l;  t2:=l; 

pretest( recogmodelno, il , tl ,t2); 

if  tl<>t2  then  calculate_coord( recogmodelno, 

oritx,ority) 

else 

pretest( recogmodelno, il+l,tl,t2); 

end; 
end; 
end; 

'  egin(*  main  *) 

interest; 

recognized; 
end. 
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